(CGM.90) 

(ii). Julia Sets : Julia Sets are produced with the same 
formula as the Mandelbrot set, but the starting values are 
different. That is c is more constant, and z0 is the starting 
point on the plane. From this definition, an infinite number 
of Julia Sets; one for each value of c. In fact, there is a 
Julia Set that corresponds to each point on complex plane. 
There is an interesting relationship between the Mandelbrot 
Set and the Julia Sets. In a way, you can, think of the 
Mandelbrot Set as an index for the Julia Sets. For values 
of c that are inside the Mandelbrot Set, you will get 
connected Julia Sets. That is all the black regions are: 
connected. Conversely, those values of c outside the 
Mandelbrot Set, you get unconnected sets. 





Fig. 2 : Julia sets 


| 
a P 

(iii) Leinian Group Fractals : Kleinian Grn ee 

are fractals based on 2 pairs of Mobius transfy race 


and allow you to produce Quasifuchsian, Single, 
Double Cusp. “SP, ang 






' Fig. 3 : Leinian Group Fractals 
(iv) Newton Method Fractals ; Isaac 
discovered what we now call Newton’s method 4 
1670. Although Newton’s method is an old applica 

calculus, it was discovered relatively recent! lOn of 
extending it to the complex plane leads to a very init tha 
fractal pattern. Testing 


‘(v) Quaternion 3D Fractals : Quaternion Julia fractal 
"are created by the same principle as the more traditional 


Julia set except that it uses 4 dimensional complex numbers 
instead of 2 dimensional complex numbers. 
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S algorithm Complexity | 
thm focuses on two complexities : 


The analysis of algori 
(i) Time Complexity 
(ii) Space Complexity 

As compared to time analysis, the analysis of space 
requirement for an algorithm is generally easier, but wherever 
necessary, both the techniques are used. In this content, space 
is referred to the storage required in addition to the space 
required“to store the input data. The amount of memory 
needed by program to run to completion is referred to as 
space complexity. For an algorithm, time complexity depends 
upon the size of the input, thus, it is a function of input size 
“)”, The amount of time needed by an.algorithm to run to 
completion is referred as time complexity. 

It should be noted that different time can arise for the 
same algorithm. Usually, we deal with the best case time, 
average case time, and worst case time for an algorithm. 
The minimum amount of time that an algorithm requires for 
{1 input of size “n”, is referred to as best case time complexity, 
tly average case time complexity is the execution of an 
a having typical input data of size “n”. And lastly, the 
Fae amount of time needed by an algorithm for an input 

a » N”, is referred fo worst case time complexity. Perhaps, 
are many factors which influence the time required by . 
nilgorithm, is 
? Binary Search - . - 
as Me o ordered set of ‘N’ data items—D, D2, D3 «+ i 
. 2g “N’ distinct keys such as k; < k, < ky Sa ky> aie 
key crac starts with comparing the key Seer 7 
at Whi € given set. Thus, the result of this check ae 
time oe half of the set should be ier em 
nLOF data oe anaes eae eerie or the 
"Nd of th item until the desired data item erauieand 
UDper i nea is reached. In binary search, eat Thus ke? 
and, Witare indicated by two pointers Fate ee ‘ 
denote the current lower and upper limits for ants soe 
ithe be easily seen that if the desired key ‘kj’ 1s pre 
*t than it follows the condition as 
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BACKGROUND & Dive 
AND CONQUER METHOD 


~Cuapter In A NuTSHELL 






k; = k; s k, 
Ifthe upper limit is less than the lower limit, the search is 
unsuccessful. 
u</ 
The middle key of the given set is obtained by 


m= [za] 


O Merge Sort 

The merging of the two sorted arrays can be done so that 
the resulting array will also be in the sorted form. If we decide 
to use same technique for creating the sorted array, then the 
requirement will be the two arrays, which we are going to 
merge, must be sorted, Merging is the combination of two or 
more sorted sequences into a single sorted sequence. 

Sorting by merging is recursive, and uses divide and 
conquer strategy. In the base case, we have sequence with 
exactly one element in it. Since such a sequence is already 
sorted, there is nothing to be done. 

To sort a sequence of n> | elements. 

Divide the sequence. into two sequences of length |n/2| 
and |n/2|; recursively sort each of the two subsequences; and 
then, merge the sorted subsequences to obtain the final result. 

In a two-way merge, two sorted sequences are merged 
into one. The merge function takes four parameters. The firs' 
is a reference to the array to be sorted. ° : 

The remaining three, left, middle and right are unsignec 
integers. It is assumed that ar 

left < middle <right ; 

Furthermore, it is assumed that the two subsequences o 
the array. - , 

-array[left], array[left + 1], array[left + 2], .... 
array[middle] 7 
and 
array[middle + 1], array[middle + 2], ...., array[right 
are both sorted. = 3 
O Quick Sort — . 

Quick sort technique is based on the divide and conque 

design technique. In this, at every step each element is place 








TTT 

—*_—_——K_—_~—as_ese_eee____a___——_—_—_—_ 7, 

Q.8 Solve the following recurrence relations and find 
their complexities using master method 


(i) T(n)=2T(\n)+ logn 


(ii) T(n)=4T(n/ 2)+n? [R.T.U. 2018, 2012] | 
ET 


10 Show all the steps of Strassen’s maine 


Q.10 Show all the steps of Strassen’s matrix 
algorithm to multiply the Sollowing 


Ans.(i) T(n)=2T(Vn)+log,n | 
We have a=2, b=1, f(n)= log.n and 


n!°8b a_ n!°81 2_ 082 


since f(n) = Q(n!8 2+) 
where ex 0.2 applies if we can show that the regularity 
condition holds for f(n). 
For sufficiently large n, 


af(Vn) = 2Vn log Vn <2Vn logn 

. =cf(n) for c= 

Hence solution is 
T(n) = 6 log, n 

(ii) T(n) = 4T (n/2) + n? 

We have a = 4, b = 3, f(n)=n? 


and 8p a _ 08s 4 
Since f(n)O(n!°83*-©) where e=1, 
Then solution is De 

T(n) = @n? 


—=_—<—————E—————_—_—_—_—_—_—_—_—_———— 
Y.9, Consider the following function 
int Sequential Search(int Af], int & x, int n) 
{ 
Int i; 
For (int i=0, i<n && afi]!=x;i*+ 
If (=n return i;) 


Determine the average and worst case 


complexit 
of the function Sequential Search. df 


[R..U, 2017] 


ns. The worst case time com 
last position 
Twseq search (n) =n 
=@©(n) . os 
On average, we will find the item abou 
t, we will compare against n/2 items. A 
efficient become insignific 


complexity is O(n). 


| ¥(0-i+1) 
Tj seq search (n)= oe 


_ pea Diez 


plexity when element is found 


t halfway into the 


vems. As n gets large, the 
cants in our approximation, So 





multi licatiy 
n 


RIU. my 


Ans. Strassen’s Multiplication Method — 


Ps = (atd) (e + n) 


Ps = (b—d) (g + h) 
= (2-8) (9 + 6) 


P= (a—c) (e+ f) 
=(3-4)(1+5) 


Ps +P, —Pp, +P, 
P;+Ps—P3~Pr 
77 +64—30-90 
3477-1246 


of Algorithms 


[ain best-case, average Case, worst-case running 


analysis of Merge Sort 


forse sort repeatedly divides an array into equal/near 

s until the size of each sub-array is Teduced to 

* starting from the left hand side consecutive two sub 

ea combined together in sorted order, recursively. This 
: «is to be repeated until we get a Single array at end. 

p Merge sort incorporates two main ideas to improve its 






apal®® 


-aptime : 
Fi ssal list will take fewer steps to sort than a large list, 


“Fewer steps. are required to construct a sorted list from 


Analysis 


el 7 8 3 9 2 
Cs. 2 [i] 






___ Arecursive merge sort algorithm used to sort an array 
of7 integer values. These are the steps a human would take 
‘oemulate merge sort (top-down). 

In sorting n objects, merge sort has an average and 
Worst case performance of O(n log n). If the running time ot 
netge sort-for a list of length n is T(n), then the recurrence 
To)=27 (1/2) +n follows from the definition of the algorithm. 
| In the worst case, merge sort does an amount had 

“omparisions equal to or slightly smaller then (n logn-2" 
bey is between (n logn-n+ 1) and (n log hal 


400 log n) best, average and worst case complexity because 


Merging is always linear. 
3 Xtra. O(n) temporary array and back. 
‘Extra copyi a in 
4 eae coPying to the temporary array 
Setul only for external sorting. 


d back. | 


. . J _ ; : f en 
‘ : Write an algorithm to search an element from a gv 


array by binary search method. ear a 
Complexity of the algorithm. WAU, 


ee 





Ans, Binary Search 


ci See: ei is a fast searching algorithm, but it works 
Eueane: ata. It adopts a divide and conquer approach. 

ry time it reduces the size of list in which search is 
performed. 

The basic idea is very simple : 

“Ifwe havea list of elements, already sorted in increasing 
order, Wwe just have to compare the key we are searching 
with the middle element.” Following situations arise : 

e — Key < Middle Element : Hence, we should restrict 
our search in first half of the list. All elements in list after the 
middle element are greater. 

e Key > Middle Element : We should restrict our 
search in second half of the list. All elements in list before 
middle element are smaller. . 

e Key = Middle Element : The search is over. We 
have found the position of our key in the list. 

In first two cases, we may recursively call binary search, 
with list reduced to half. Thus, in recursive implementation 
we keep on recursively calling binary search untill there is 
only one element left in the list. This is the base of recursion. 
Here only two situations arise : 

e Key=Element : Search is successful and we report 
the position at which key was found. 

e Key x Elment: Search fails. The key does not exist 
in the list, since there are no more elements to compare with. 

The algorithm can be implemented either as recursion 
or as iteration. . 

The recursive version of Binary Search 
Binary Search1 (Key, A, Ib, ub) 

// Ais the array of elements 

// key is value of element to be searched 
//\b gives lower bound of array 

/fub gives upper bound of array 

Step:1 : if (Ib > ub) 


-Step 2 : return “Search fail” 


Step 3: m:= [(Ib+ub)/2]; /!position of middle element 


Step 4: if (key = A[m]) 

Step 5: return “Search successful at” m 

Step 6 : else if (key < A[m]) | 

Step 7 : BinarySearch] (key, A, lb, m—1); 

Step 8 : else BinarySearch (key, A, m + 1, ub); 

The lower bound of array gives the position of first 
accessible element. Upper bound gives the last element , 
accessible in array. Like, if we have a subarray from position 
5 to position 9, Ibis 5 and ub is 9. Step 1 checks the condition 
when array has no elements within the bounds. Since there | 
are no elements to compare with, search stops here and key 
is not found. Hence failure is reported in step 2. step 3 
calculates the position of middle element. To have an integer 


RAG 


en 
imber as position, we use floor function for case of ev 


zed array. Like, if we have array of eight elements, Ib is | 
id ub is 8, there are two middle elements at 4 and 5, but m 1s 
If the key is equal to middle element report success at step 
else go to step 6. Here we compare key and middle element. 
ep 7 recursively calls Binary Search with first half of array, 
1en key is lesser than middle element. Step 8 recursively 
lls Binary Search with second half of array, when key is 
eater than middle element. 

First call to this algorithm will be Binary Search] (key, 
1, n). 

The iterative version of Binary Search 
narySearch2 (key, A) 
is array of elements 
ey is element to be searchéed 


plilbs=1; 
p 2: ub : = length (A); 
D3 : while (Ib <= ub); 


94:m:= [(lb + ub) /2] ; //position of middle element 
15: if (key = A[m]) 

) 6 : return “Search successful at” m; 

) 7 : else if (key < A[m]) 

8:ub:=m-l; . 

9: else lb:=m+1; 

10 : end while; 

) 11 : return “Search failed” ‘ : 4 

By changing values of Ib or ub, we reduce the range of. 
ents in list where w perform search. The failure case is 
n there is no element in the sublist. It is indicated when Ib 
, for which while loop terminates and the failure 
ep.11 is reported. , 

Analysis . 

With every iteration the list is divided into half. The 
parisions and call overhead is cons 
ion thus formed is 

T(n) = T(n/2) +¢ 

This recurrence relation has following solution 

. Tn)= O(log,n) 

In worst case of search failure, we 
time. For any average case, log n is acceptable limit, A 


ase is when the key is found at middle Position in first 
)bviously, the run time in this case is O(1). 


message 


tant. The recurrence 


will reach it within 


Express the Sollowing function USi. 


ng asympt 
1otations: i i 
i) 6x2 +7? 
(i) I2n(n-1) [R.T.U, 2013) 
—ooeeeeeeeeeeeeeeeeeeeee— ———— 


Ans. 
When n24 4, 
n* <2n 
So, fn) $6 x 2+ 2"= 7x 90 
Hence f(n) = O (2") 
Where, C =7 
Ny =4 
n(n—1) 


— i) F(n) “2 
Then A=) eo(n) 
’ F(n)>O(n) we get 


Fo) ="S 





_ ie. maximum order is n? which is > O(n 
Hence F(n) ¢ O(n) 7 


— € O(n?) as F(n) < O(n’) 





But 
and 20) 010°) ty 
Similarly, , | 

| m=) 240) Lo F(a) 2040) 


a eat? F(a) 20) 





ins 
Q.14 Illustrate the operation of merge sort on fori 
array 10, 20, 5, 23, 45, 34, 12. Also a gol 
algorithm & its complexity. . ail 
OR Q 
Der "ve the recurrence relation ft oF iad 
“gorithm time complexity. Also sent i wt ois 


sotl 


OR 


B.Tech. | re hie St : 
ech. (V Sem.) C5. Solveq > Ay Algorithms 
2) Wee —_ oo the best case complexi 


Algorithm & its Com | 
orithm. [R.T.U, 2017] gi be. * 


plexity : Algorithms for mergesort is ~ 
als ven below : a“ = 5 diionss 
rge sort On 10, 20, 5, 23, 45, 34, 12 sorting the given} - ‘wien (int[ Ja, int left, int righty 
¢ = . 
‘Z z using METER SOT es if (right > left) 
gu 10, 20, 5, 23, 45, 34, 12 ome 


Middle = left + (right— left)/2; 
mergesort (a, left, middle); . 
mergesort (a, middle+1, right); 
merge (a, left, middle, right); 


} 

Assuming N is power of two, 

For N = | : time is a constant (denoted by 1) . 

else : time to mergesort N elemets = time to mergesort 
N/2 element + time to merge two arrays each N/2 elements. 
Time to merge two arrays each N/2 elements is linear, L.€., 





N. 
Thus, we have; . yi 
l T(1)=1 
2. T(N)=2T(N/2)+N 
Final sorted list:5101220233445 0 , _ Dividing Step (2) byN: ‘ 
Algorithm used to sort the sequence: MERGE-SORT] 3. T(N)/N = T(N/2)/(N/2) + 1 . 
0,54,A) : | oO -: Nis power of two, so we.can write 
Lpel 4. TON/2)/(N/2) = TON/4)/(N/4) + 1 
Zren € at >in 5. TN/4)/(N/4) = TON/8)/(N/8) + 1 
Kqe(ptr/2 . | 


6. -T(N/8)/(N/8) = T(N/16)/(N/16) +1 
8. T(i2V2=TU)/1+1 | 7 : ; 

-. Adding Step (3) to (8), the sum of their left hand sides | 
will be equal to sum of RHS. 


4.MERGE SORT (p,q, A,r), -... 
5. MERGE SORT (q+1,1,A,p) ~~ 

6. MERGE (p, q, A, r) 

MERGE (p, q, A, r) 


lm < p-qtl T(N)IN + T(N/2)/(N/2) + TON/4)/(N/4) +... + T(2Y/2 
2m er—g - = T(N/2)/((N/2) + TIN/AY/QN/A) + ... + T(2/2 + TUY/I 
3. 1] initialize line arrays -t+logN 

See Ul. nm +1], Lp[l....m +1) ini ‘- sions ing N faut of f's'cn RES. 
4. for i= 1 to n 9, T(N/N=T(1)/1 + logN 
>. do L,[i]= 4[p-i+l] . T(1) is 1, hence 

- = N) 

ew See ee 10. T(N)=N+NlogN=O(NlogN) 
7 - : 7 . fs 1] hence complexity of merge sort algorithm is O(N log N) 
8. fork = Pp tor Q.15 Describe various asymptotic notations. 
9 : : j 3 . 


ad . eke .T.U. 2018, 2016, 2012, 
** do for i=1 to-n: a : 


rt) L [<2]. Pa ain asa function of its input size n. Call it f(n). 
g12,..7" then A [k] = 4 [i] Now, in order to have an estimate of the limits of this paren 
13 aca 1 we take another function g(n), for which we alrea y know 

Sia wins belt fhe behavior [or it is easy to observe the behavior of g(n)). 
- else A[k]= 40] The limits can be chosen according to what we desire 
ne. is jejtl. overestimate, underestimate, etc. © 
Tetum A 


L AAS ) 


“The Asymptotic Notation is a representation 
which describes the limiting behavior of a function when 
the argument tends towards a particular value or infinity, 
usually in terms of simpler functions.” 
Depending on the limit applied, the various notations are : 
Big-oh Notation (O) : The upper bound for the function ‘f’ 

*is provided by the Big oh notation (O). 

Definition : Considering ‘g’ to be a function from the 
non-negative integers into the positive real numbers. Then 
O(g) is the set of function f, also from the non-negative 
integers to the positive real numbers, such that for some real 
constant c > 0 and some non-negative integers constant no, 
f(n) <cg(n) forall n2n, : 

For all values of n > ng function ‘f” is at most times the 
function ‘g’. It can be noticed that for all ‘n’ a function may 
be in O(g) even if f(n) > g(n). Thus, 'g' provides an upper 
bound by some constant multiple on the value off for all suitably 

‘large V(i.e.n'>no). 

. The set O(g) is usually called as oh of *g’ or big oh of 
“g’. As O(g) is explained as a set, it is a good practice to say 
“f is oh of g” or “f is big oh of g”. 

Some common asymptotic functions are as follows : 

constant : 1,........ 

logarithmic : log n..... 

linear : n....... 


~ exponential : DP cits 
factorial : n!, ...... 
cubic : n>, .:.., 
In general, 
O(g(n)) = {f(n) : There exists positive constant such 


that 0<f<Cg(n)foralln, n>n, 


Example : For the function f(n) =100n+ 6 from the 
definition of Big oh Notation we can write, | 


O<f(n)<cg(n) 
0<100n+6<cn 
Since, big oh notation puts an upper bound on the éiven 


function, constant c has value slightly greater than the 


coefficient of highest order term, 
The inequality can be made to hold for any value of 
n26 by choosing ¢>10}, 
Thus, forc = 101 andn 1 = 6, it is verified that 
100n +6=O(n) 
Big Omega Notation (Q) : The lowe 
function ‘f? is provided by the big omega SS ar oe 
Definition ; Considering ‘g’ be a function Goi th 
non-negative integers into the positive real numbers Th 
{2(g)is the set of function ‘f? also form the non-neg ti . 
integers into the positive real numbers, such that ite sane 


: B.Tech. (V Sem.) Cs. oo 
real constant c > 0 and some non-negative itepes EN 
n f(n)2cg(n) for all n,n2n,. "co 
‘0? 


For all values of n <n, function Pts alo 
the function ‘g’. Here, “g’ provides a lower bous, 
constant multiple, on the value of'n' for aj} Suitabi ~ 

ar 


(ie.n 2n, ) . 
Example : For the function f(n) = 4p3 +) 
the definition of big omega notation we can oe +3, 
O<cg(n)<f(n) 
or sO Sen? <4n?4+2n43 
Since, big omega notation puts lower boung ON the 
function, constant c has value slightly smaller than oe "Bg 
the coefficient of highest order term. qual 
The above inequality can be made to hold 
of n by choosing c< 4, 
. The value of n though needs to be a non-n 
greater than or equal to zero, i.e., n >. 
Thus, for c = 4 and ng = 0, it is verified that 
4n? +2n+3=Q(n3) 
Thus, the given function is of the order of Qn’). 
Big Theta Notation (8) : The lower and upper bow 
for the function ‘f’ is provided by the Big Theta Notation 
Definition : Considering ‘g’ be a function from the 
non-negative integers into the positive real numbers. The 
8(g) = O(g) \Q(g), that means, the set of functions thatar 
both in O(g) and Q(g). The 6(g)is the set of function f'su 
that for some positive constants C, and c, and an ny exist 
such that cg(n)<f(n)< c,g(n) for all n, n2n,.4) 


“fo = 8(g(.))” we mean “f is order of x. . 
find out the order of function f(n) = 7n + 5 in Big The 
Notation ; 
‘From the definition of Big Theta we can write 


5 ZF Al gorithms | 
(le o-notation denotes an upper bound same as Big 


ut this upper bound is not asymptot; ] 
an it om be defined as follows: si tically tight 
ally» 


fo por a given function g(n), o(g(n)) Bives the set of 





























tions f{n) as ee 
fu o(g(n)) = {f(n) : for any Positive constant ¢ > 0 
there exists a constant Ny > 0 
such tht 0 < f(n)<c¢ 8(n) for all n > Ny} 
Thus, f(n) = o(g(n)) for any and every constant positive 
sof c. ASN becomes larger and approaches to infinity 
becomes insignificant as compared to g(n). . 
Mathematically, 
lim f(n)/g(n)=0 — 
n> 


é Example : Examples of few correct bounds for little o 
tation are as follows : 
_3n+5=0(n’), as 3n+5=O(n2) © 
10n? + 7 = 0(n*), as 10n? + 7 = O(n3) 


is 
fo) 


forany ah, 


Cgative inte 


bound as 
jim f(n)/g(n) =0 


i.e. 
So, f(n) = 3n + 5 40(n) 
“Similarly, lim 10n? +7)/n? =10#0 - 

n—->co 


Thus, f(n) = 10n? + 7 40(n?) 
‘Little Omega Notation () 

Big Omega Notation imposes asymptotically tight lower 
bound on function f(n). To write that 3n + 5 = Q(n’) is not the 
ighter lower bound on the function because it has the smaller 
near function that also satisfies the big omega notation, i-e., 
01+5=Q(n). Little. Omega denotes the loose lower bound 
the function. For above function, 3n + 5 = @(n”) is correct 


lim (3n+5)/n=3+0 
n—-<o0 


g(n) SC2g (n) und, Formally it can be defined as follows: . ; 

or cin S$7n+5<cn intone 4 Biven function g(n), o(g(n)) gives the ee “ 
j NS I(n) as @(g(n)) = {f(n) : for any positive constan 

i ese hold ft > 0 t ere exists a constant ng > 0 such that 


SC a(n) < {(n) for all n > no} 


The right-handed inequality can be made to 
- Asthe value of n approaches infinity, 


any value of n >5by choosing c>8. Similarly, the left <M 


inequality can be made to hold for any value o" BE as Compared to g(n). 
choosing C1 <7. aa: athematically, | 
Ins 7n45.<8n evel] lim £()/g(n) = 


Thus for c, = 7; ¢ = 8 d =5 it is P 
’ 9 & = an No ’ n). 
Int = 6{n). In other words, f(n) is of the or der of x 


: bea ofa sample : Let us try to understand this with the help 
Little oh Notation (0) : Big oh notation thal? Mples : 


+3 Od tight bound on funetion f(0).!E¥°%, 3 3n+5=a(1),as3n+5=2() 
= O(n"), it is not the tighter bound on this fu" Bis 10n? +7 = w(n), as 10n? +7 = Q(0") 


have the Smaller linear function that also satishies 


“lf We wr: : ‘ ld be an incorrect 
i . writ +5= , It wou 
relation, Lé.,2n+3 = O(n). ong as Bean =n) 


fn) becomes very 





ae! _ AAS 
, 
jim £(n)/g(n) #00 
ie.” lim (3n+5)/n=3400 
noo 


So, f(n)=3n +5 # @(n) 

Whereas, for 3n +5 % (1), 
lim (3n +5)/1=00 
n-0o 7 


Thus the above little omega notation for the function 


3n+5 is correct. 


Graphic examples of the 0,0 and Q notations. In 


each Part, the value of No Shown is the minimum possible 
value; any greater value would also work. 


(a) 8-notation bounds a function to within constant 


‘factors. We write f(n) = 0(g(n)) if there exist positive 


But if we write 3n + 5 = o(n), it would be an incorrect constants no,c,, and c, such that to the right of no, the value of 
f(n) always lies between c,g(n) and C,2(n) inclusive. 


Cc, g(n) 





' f(n)= 8(g(n)) 
: Fig. 

(b) O-notation gives an upper bound for a function to 
within a constant factor. We write f(n)=O(g(n)) if there are 
positive constants np and c such that to the right of No, the 
value of f(n) always lies on or below cg(n). 


cg(n) 





f(n) 


No : 


_ f(n)-O(g(n)) 

_ Fig. 
(c) Q-notation gives a lower bound for a function to 
within a constant factor. We write f(n) = Q(g(n)) if there are 


positive constants no and c such that to the right of no, the 
value of f(n) always lies on or above cg(n). 


MT aid 






cg(n) 





n 
f(n)-Q(g(n)) 
Fig. 
i ooo 


 Q.16 (i) Solve the recurrence 
T(n) = T(n-1)+T(n-2)+1, when T=0 


T()=1 
(i) If fin) = 100 x 2"+ +n show that - 
fin)=0 (2") [R.T.U. 2017] 
Ans. (i) T(n) = T(n = 1) + T(n—2) + 1, when r= 0 
T(1)=1 
- T(0)=0 


T(2) = T(1) + T(0) + 1 =2 
Recursion Tree 
“*" Depth of tree is n and upto the (n/2)th level each level 


will have 2 nodes (0 <k < log, (n + D). Final base case is 
-F(1) and F(0). 


F(5) 
oF) F(3) 
ia) Can ae 
FQ) FQ) F2) F(t) 


FA ol \ he 


F(2) F(1) F(1) FO) F(1) F(0) 


F(1) .-F(0) 
. Fig. 
Total nodes i In recursion tree 
=1+2+4+...+(n-1) 
= 1(2"- 1)(2-1) 
=2°_] 
Recurrence relation = = 0(2") 
Using closed form of F ibonacci series 


ree te A ek 
"9-9 E 
_ 1+¥5 
$ tn” 1.618 (Golden Ratio) 
po eeepc 
2 } since, 9 





“| Q.17 One file has ten characters (a, b,c, ‘Wn’, ef gh! 


- Hence, F, = $” / V5 
T(n) = O(1.6") 
(ii) f(n) = 100 x 224+? +n 
f(n) = O (2") 
let g(n) = 2" 
then f(n) = O[g(n)] 
0 < f(n) < g(n) 
y n2Np. for a t+ve constant c. 
"4,0 «107 T 


0.8 x 10” 


Value . 
0.6 x 10” 


0.4 * 10” 





7 10 20 30 40 50 
n—>- , 
Fig. 
Eliminating lower order term 
f(n) = 100 x 2"+ n3 os 
for c = 200 as ial 
100 x 2"+ n3+n< 200 x on i 
&' f(r) = 0(2") -- “ony 
f'(n) = 100 x 2°+3n? +1. 
200 x g'(n)=200x2" 
since, both are monotonically. inoreasihe function wit 
respect to n. 
f(1)= 100 x 2+1+1=202 
200 x g(1) = 200 x 2! = 400 
200 x g(1) 2 f(1), we can say that fin) = 0(2") 


% 
‘\ 


oo oe 


whose frequencies are 27, 31, Il, & 72, 5h m3 
_ 2, and 10 respectively. _ 

() Find optimal binary merge paiter 

above file, 

(ii) Generate Huffman code for str ing ‘Be en 

(iii) Translate given Huffman code a 

1110000110 into text format by above PY yx 


+s 


aa 


Ans.(i) 27, 31, 11, 5, 72, 51, 89, 33, 2, 10 
Sort the elements in increasing order 
2,5, 10, 11, 27, 31, 33, 51, 725 89 











273133517289 - 


3133517289 











B.Tech. (V Sem) : . 
(AA2) — = IN Scie | ag of Agortenms 
(ii) Frequencies for string (Given) 7 Pen) | (402 =e is, We know that ‘1’ means the traversal into 


5189 7252733 The given free is | sar cotion so “11” means ‘g?. 
Step 1: Minimum two element | gt’ “Now follow the same procedure and decode thi 
: pattern: So decoded pattern is 7 
“it hee | | | f g Extra bit (ignored) 
| | o11:10 11.11.1100 00 11 0 
I} "We have seen a extra bit so we ignored this extra bit 


xpd StOP seeing. ; 
So text of equivalent to the given binary pattern is 


spregeetis. 











| 
Step 2:32 33 51 72 89 


ee 
018 Apply Strassen ’s algorithm to compute, using 
ax2matrices, existing the recursion when 
n=2 





tep 3: 51 65 72 89 
1021] [o101 


4110 : 2104 
0130| |\2011 
5021) |1350 


sss 
a 


Ans. In Strassen’s algorithm, we proceed by partitioning the 















| . given matrices into submatrices. 
_ Now we consider the left side of the node is bit 0’ 
ee and right side the node is ‘1’ so we get new tree is Cui Ca = An An Bu i Bo 
ep 4. 1289116 Cy) 1 Cop | [Ani | Aza | [Bar | Bao 
1 012 1] fo 1!0 4 
4 111 0 l 10 4 
C lo rts of |2 or 1 
I 2 
ep 5: 116161 | , 
P | 5 012 1} [1 315 0 
Let us complete each A * B matrix by following 
formula, . a 
S1= (Aq + Ag2) * (Bu + Baa) , 
(T1 01 [3 0 (Anpe ) 
= x 5 
lakh Wa tls » 
4 0] fl 2 
= x . 
- (6-2) [71 | 
ates eo] =[SER STD Goraeen 
> 2)+ (4% 
So we encode this pattern according 19 ae fb (6x1)+(2x7) (6%2)* 
' pb pick the 4-bit so bit is ‘1111’, This bit does”, qysk] 4 8]. 
© given huffman tree so we take 3-bit, so bit 1S. if eo”, | S, -| | 


| also not exist so we take 2-bit, so bit is ‘11’. The ¥ 


[R.T.U. 2013] | 


S. = (Aq, + Ay) x By, 
-(( a 3 0]) fo. 1 
5 0] |2 1 (3 i : 
-|; 1] [0 1 
‘(7 1)"|2 | 


cane (3x1)+(x1) 
(7x0)+(1x2) (7x1)+(1x1) | 


2 4 
82 “lo 8 


Mee) 
“a af{cs 4| 


_[(-1x1)+(-5x 0) (1x 0)+ (0x4) 
~|(-1x4)4+(-5x1) (4x 0)4+(1x 4) 


_[-1 0 
3° 1-9 4 
S4 = Ag * (Bz; = By) 


[3 0] ({2 0] fo 1 
“lo -a1"Ua 3] (21 

> 4 he | 
= x 

2 1| |-1 2 
_[@x2)+(-1x0) Ga 
| (2x2)+(-1xI) (<1 x2)4+(2x)) 


, 16 -3 
S413 0 
Ss = (Ay, + Ajz) * Bao 
_(fi 0],[2 1 ! 1 
(a aftr olf*ls 0 
|: i } 1 
= x 
5 1] [5 0 


*_[@x1+dx5) ae 
~ [6 x1I)+0x5) Sx1)+(x 0) 


PS 
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Cx. = 8, + $;-S, +S, 


. 4 8 -1 0 
= + 
20 14] |-9 ‘ 


Ss = (Ag) — Aq) * (Bur + Bia) 


CHM HD 


ee oe 


one SA 
~ | (1x 0)+(-1x 2) (1x 2)+(-1x5) 


a 2 
Si 33 


aed 


Thus, the final solution is 


1021) f0 101) [5 47, 

S, = (Aj) — Ay) X (By, + Boy) — (4.1.1 012 10 4 Ja sag 
2 1] [3 oJ) (f2 0] fi 1 0.13 0/ |2 01 1) [8137 

be Dr Hed) | berdbs sol bar 


CN6N6"®s®quar{lanne=a®aRae=Se=eaeaa@ama=["y_ry*@"*=_=awea=_., 


Q.19 Give asymptotic upper bound or lower bound on 
each of the following recurrences. Assume that T(y 
_ ls constant and make your bound as tight as possibh 
Justify your answer (any four). — 
(i) T(n) =3T(n/2)+n logn 
(ii) T(n) = 5T(n/5) + n/n logn 
(iti) T(n) = 4T(n/2) +n? Vn 


_f-1 1] [3 1 

new sath ie 3 

=| en ane (-1x1)+(1x3) 
(-1x3)+(-1x6) (-1x1)+(-1x3) 


-£3..2 
ia ee 


Now, Cy, = S; + S, = S; + S7 (iv) T(n) nar(2is}ens2 
4 8] [6 -3 

= (v) T(n) = Tin -2) + R.T.U. 2lll 

ke alls | (n) = T(n-2) +2 logn [ 

——————————————— 
. 3 3. 3 Ans.(i) Comparing given recurrence with the standad 
-| }-| recurrence relation used in Master’s theorem, we 8 
10 5| |-9 -4 a= 3,b=2, f(n)=nlogn 
[5 4 . ‘loss _ log} _ 07298 ; 
Cy, = 4 5 sain order of f(n) can not be directly expressed . 
mial, w i 
Cy =5,+5, , consider | | 
‘ 0 (ae . 
|" ‘| 8 | f(n) =0(n! = ), for which 
eee log?=0.7298 
- -|; a ' where ¢ 4. 0.2 
aoe es bis 3 of Master theorem applies. ani! 
= Orming the regul e extrac’ I, 
Coy = Sz +S, should be satisfied. afin) Sia one constant! 
f 2 | ; “| If3f (1/2) <en log n , 
= + 
2 $1 13. 0 , | n, (n 
» . = 3 Froe{ 2) Scnlogn’ 


B.Tech. (V Sem.) Gs, Soe 
'd 
- | -[ i : << 
Ss “|. | | a | 


Ca ues of n, (3) | 
for large values O° (5) 0 log n < cn log n or 
nlogn 
‘ where,¢ a 2 
Thus, the solution to the recurrence relation is 
T(n)= 0(f(n)) = O(n log n) 
(ii) We have _ 3 
a= 5,b=5, f(n) =n/nlogn 
So, nose =log,5 =n | 


None of the Master theorem cases may be applied 
pre, since f(n) is neither polynomially bigger or smaller than 
sand is not equal to a(n logk) for any k > 0. Therefore, we 
solve this problem by algebraic expression. 

T(n) =5T(n/5)+ n/n logn 

= §(5T/n/25) + (n/5)(log(n/5)) + n/n logn 
=25T(n/25) + n/log n(n/5) + n/n log(n) 
i-1 


= S'T(n/5') + 2, n/nlog(n/5') 
j=l 


When i = log, n the first term reduced to Slog," T(1), 
so we have 


; lo ani . 
T(n) =n@(1)+n s (n/(log(n/S*"))) 


jal 


logs n-1 
=O(n)+n > (1/logn—-(j—})log, 5) 
jel 


logs n-l . . 
=0(n)+n(1/log 5) Y. (Mlogsn-G-1) 
, e 


5 logsn l 
= 0(n)+nlog;2 >) (7) . 


j=2 
This is the harmonic sum, so, we have 
T(n) = @(n) + Cyn én (logsn) + 8(1) = (0 log n). 


diy T(n)=47( 2} +n? 


Vn =logn 


~ 


(AA.15 ) 


We have Master theorem case 2 as 


f(n) =0(n°# log‘n) =>0 (nie log*#! n) 


fork >0 
From this theorem a = 4, b = 2, f(n) =n? logn 
So, noes = n2 : 
Since f(n) =0(n*logn) — 
T(n) = 0(n* log?n) 
T(n) = st(345)+2 Ans. 


(iv) For T(n) = O(n log n) 
We have to show that for some constant c 
T(n) sen logn 


n - (n n 
T(n) <cn| —+5 jlog| —+5 j+— 
” (5 Jos(§ ea 


=enlog{ 2) +1042 
3 2 


=en logn - enlog3+10+> 


=cnlogn—en+10+> 


=cnlogn—(c—-1/2)n+10 
: =cnlogn—bs<cnlogn 
if c > 1, b is constant 
Thus, T(n) = O(n log n) Ans. 
(v) We solve this problem by algebraic subsitution 
T(n) = T(n-2) +2 logn 
=T(n-2)+2 logn 


=O(1)+ 2 ogi 
‘ is-1 


= 0(1) + log i 


i=l 
= Q(1) + log (n!) 
= Q(n log n) Ans, 





af Algorithms 
“ast character of either sequence does not match: 
Hes 24 for example. , : 
ons his case, p; and qj cannot be the Part of LCs 
neous y as for this they would have be the last 
si ater of the LCS. 
ie either p; be the part of LCS or q; be the part of 
Tbeeod dition may also arise where both Pj and q; are 
Cs: oarts of LCS. 


activities, each job is scheduled to use some resources, 
condition might arise where multiple activity has its start and 
finish time denoted by ‘si’, and ‘fi’ respectively. A condition 
might arise where multiple activities are scheduled to have a 
common resource, or the start or finish time of activities may 
overlap. From the given set of activities (jobs), we can say 
that Ai and Aj are non-interfering activities, if and only if they 
both have different start and finish times that means their 





ais 
Wore 


Cuapter In A NUTSHELL 


0 . 

Z if 
= sts mul[i,k] +m mul[k +1, j]+ Py P,P; 

0 Longest Common Subsequence 

The dynamic programming (DP) technique Suggests 

breakup of the main problem into several smaller subproble, 
There are many ways of breaking up the Strings but we shal 
concentrate on the prefines of the string sequence, A pref 
of a sequence indicates an initial String of values 
Pi = <P1, P2, P3 ---- Pi>- Po indicates the empty sequence, Tk 






















Q) Matrix Chain Multiplication ; ; 

The matrix chain multiplication problem involves a series 
of operations to be performed. A dynamic programming 
approach gives the optimal sequence of operation for this 
problem. The MCM problem is important in the area of 
computer design and database, as one wants to achieve code 
optimization and query optimization. 

In dynamic programming approach, we always break 
down the main problem into several smaller subproblems. Later 
the solution to these subproblems are combined to give the 


if I<hisk, 


got considering all the cases we can say 


0 if i=Oor j=0, 
c{i-1,j-1]+1 if, j>Oandx, =y, 


csi, j= max(cfi, j-I,cfi-1 jl) ifi,j>Oandx, +y,. 


g o/t Knapsack Problem 
- Inthis problem the list of items are indivisible, that means 

wither we take the item or discard it. 

Given a set of n items and Knapsack having Capacity w, 
ich that each item has some weight w; and value v; then the 
roblem is to pack the Knapsack in such a manner so that a 
maximum total value is achieved. 

The problem is said to be 0/1 Knapsack problem because 
the item from the list is either rejected or accepted.. 

We can formulate the subproblems as recursive rule 


start and finish times do not overlap, A; = [s;, f;] and 
Aj = [s;, fj], so for non-interfering A; NA; = 9. 

Here we are giving the greedy strategy which provides 
the optimum result. The idea behind this strategy is same as 


| we are’ discarding that activity which has longer duration 


(f; — s;). In this Strategy, we first select the activity with 
minimum duration (f;—s;) and schedule it. Next, we skip all 
activities that interface with this one, that means we have to 
select non-interfacing activity having minimum duration and 
then we have to schedule it. The process is repeated until all 
the activities are considered. It can be observed that the 
process of selecting the job becomes faster, if we assume 
that the jobs ave arranged in an increasing order of their finish 
times. 
» , HSS... <k. 
C) Optimal Merge Patterns a. 
A greedy attempt to obtain an optimal merge pattern is 


method is related to compute the LCS for all possible pairdf 
prefixes. Consider LCS[i, j] to be the length of the longest 
common subsequence of p; and qj for example. 


Kp[k-1,0] if QO, >Q@, 


Kikol= easy to formulate. Since merging an n-record file and an 
plko]= max(K ,[k = 1,0], K p[k-1,0 -0,]+ Vx) otherwise 


m-record file requires possibly n+ m record moves, the obvious 
choice for selection criterion is; at each step merge the two 


solution to a main problem. As we know that we cannot change 
the order of matrices, therefore the only reliable task is to, 
manage the parenthesis. 



























to ia ps Suse a enn yaar ae P3 = teas Q Knapsack Problem smallest size files together. Thus, if we have five files 
optimum matrix multiplication break the rote ica ‘ = perc ‘ | Knapsack problem follows the greedy strategy where the (Xjpsvesses Xs) with sizes (20, 30, 10, 5, 30), our greedy rule 
sanelst diultsinall naire problem into several - Thus, their longest common subsequence LCS is <KP. | items are arranged in some order which is based on some | Would generate the following merge pattern. Merge x, and x, 

p maller subproblems of similar structure. We | Therefore LCS[3; 4] =2 greedy criterion : | to get Z, (\Z\| = 15), merge Z, and x, to get Z,(|Z,| = 35), 


merge x and x; to get Z;(|Z3| = 60), and merge Z, and Z;to 
get the answer Z,. The total number of record moves is 205. 
This merge pattern such as one first described will be referred 

to as a two-way merge pattern. The two-way merge patterns 

can be represented by binary merge trees. Example of optimal 
merge pattern is Huffman codes. 


QO Minimal Spanning Trees eS 
If a weighted graph is considered, then the weight of the 


spanning tree (T) of graph ‘G’ can be calculated by summing 


Greedy Criterion I : In this criterion, the items are 
aranged by their values. Here the item with maximum value 
Wsselected first, and process continues till the minimum value. 

Greedy Criterion II: In this criterion, the items are 
aranged by their weights. Here the item with lightest weight 
selected first and process continues till the maximum weight. 

Greedy Criterion III : In this criterion, the items are 
ranged by certain ratio, P;, where P; is the ratio of value 
‘Ver Weight. Here selection proceeds from maximum ratio to 


: consider the highest level of parenthesizing, where two matrix 
multiplications are considered for instance, if we consider k 
where | 


The DP method is to compute LCS[i, j] in a manner)y 
assuming that LCS[i’, j'] is already computed where i'<iand 
J' Sj, but not equal. ; . 

Basis, Either of the sequence is empty : In this 
LCS[i, 0]=LCS[0, j] = 0. That means if either of the seque** 
empty, then the longest common subsequence is also empl): _ 

When last character of both the sequence math’ 
Consider p; = qj for example 


Ain tArn% Ageion 
For this, the sequence contains only one matrix if j =j 
and so the cost of operation is 0. Thus, m mul [i, j] = 0 
The multiplication for Aj, j is computed if i<i. We can 


ries the sequence by considering each k, where i < k, jas : 

pe a, t igs r pi = <LMNL> — ratio, _ k whether the | all the individual weights in the spanning tree T. But we have 
Spinnin mutt -. mmulfi, k] and m mulfk + 1, j] are the qj = <OLNL> - araclt | Wel fter taking the greedy criterion, we chee is than the | seen that for any graph ‘G’ there can be many spanning trees. 
4 eh mais nd in chat ff ght Wi of item I; from the top of the list 1s less This is also in the case of weighted graphs from which we 


needed to compute Aj., are It is understood that beth the sequences € qual to 
ntinues 


‘L’,, thus we can say that longest common su can get different spanning trees having different weights. A 


ays PSack capacity, W or not. If W; is less than or 
Minimum Spanning Trees (MST) is a spanning tree of 


Ax+1, j(Aj,j) respectively, 
., Hen the item is selected and the whole process co 


bsequen’ 


Also assume that all these values 
a a et are computed previously | the above sequences in “L. wd) W ‘ ight, W 

a“ Si aie te Go 4 ° J The nigral longe eas ine is uence can be i “Wit Ti.25.... in item along with new cee minimum weight. 
aie ee om Px i leasion of Ai, and p, x Pj is the | by removing the a saa rie ts iit it isa pat oflom contin therwise the item having ‘W/’ is aw dd To compute the minimum cost spanning tree, we are 

€nsion o k+1.js the total number ofo ; ie S we KNOW al ues With 1.5. Ji i item along wl . 1 * thm . 

é : Perations ne cé Wi i+1> Aj425---1N resenting two algorithms : 
multiply them is p;_, p; pj. ededto | common subsequence. So, we compute LCS of Pi il! Q ett W. j : 1) Kruskal’s Algorithm — - 2) Prim’s Algorithm 

Both are based on greedy technique. ; 


‘ a : 
and q_1 = <OLN> which is <LN>. Later on, — 50 8 ah. Sequencing 







From the above discussion we have th Wi | hee ubsequence 0b sche e schedu uch a manner that itcon 
€ follo i i hat a of elected in 
mput lil , INg recursive th end of this longest common s q ODtimn. scheduling problem, a h A ied 10 ii skal’s Algorithm : I ‘ - aera weigh 
mu peas ng m mul| give the final solution which is <LNL>. $0. _ number of activities that ar 1 of "a number mace baal ae al 
= nl ; 


‘Given a set S = {1, 2, 3, - 
















AA.18 : 
and upon adding to ‘M” does not include any cycle. That 
means every time the lightest edge is selected first and then 
is added to ‘M?.(only if no cycle is obtained). 
Prim’s Algorithm : For finding the minimum spanning 
trees Prim’s algorithm-is yet another algorithm which 1s also 
based on the greedy technique. The Prim’s algorithm differs 


B.Tech. (V Sem.) C.S. Soy 
from the Kruskal algorithm only in the way of = > 
next safe edge which does not produce cycle a tng 
The running time of Prim’s algorithm is essent; i Dad int 
Kruskal’s algorithm OW + E) log V. The impo ly te (H 
algorithm is that at loops it is very similar to an al por 

Whig, 
p 


is known as Dijkstras algorithm, used for finding shox 
st 
ay 


























Q.5 Find the optimal parenthesization of Matrix-choi | Q 
Qn 


Q.1_ What do you mean by MCM problem. 





product whose sequence of dimension is (4, 104 
914 
40, 5). IR.TU. 2018, ayy 


















Ans. The matrix chain multiplication problem involves a series 
of operations to be performed. The MCM problem is important 
in the area of computer design and database, as one wants to 
achieve code optimization and query optimization. 





Ans. The chain (4, 10, 4, 40, 5) means the 
multiplied are of following dimensions. 
m;: (4 x 10), m, : (10 x 4), m, : (4 x 40), m, : (40x) 
All A[i][i] = 0 [base value] 
Thus, A,, = 0, A, = 0, A,,=0,A,,=0 


Matrices to by 













Q.2 Define dynamic programming approach. 

I 
Ans, In dynamic programming approach, we always break 
down the main problem into several smaller subproblems. Later 
the solution to these subproblems are combined to give the 
solution to a main problem. 








Sothe 


Q3 Write the steps to develop a 
algorithm. 


dynamic programming 








A,, = operations (m, m,) = 4 x 10 x 4= 160 
' _A,, = operations (m, m,) = 10 x 4 x 40 = 1600 
A,, = operations (m, m,) = 800 


Ans. Stenstadacd.: 
Ans. Steps to develop a dynamic programming algorithm 
1, Characterize the structure of an optimal solution. 
2. Recursively define the value of an optimal solution, 


3. Compute the value of an optimal solution, typically ina 
bottom-up manner. 







4. Construct an optimal solution from computed | 
information. a 

. ll 

O4 Wha. ——_—_—X__. 
Q4 What is 0/1 Knapsack problem. . + operatio® 2 
imuiiipetenticiaan (m ni = min[A,, + operations (m,, m,), Ay 3 
\ns. robiem the list of items are indivisible, that 8 a) | M4 
ce ak take a item or discard it. aieans = min[160 + (4 x 4 x 40), 1600+ (4% 10% ' 
ven a set of n items and Knapsack havin capaci =[800, 3200] = 800 oe 

such that each item has some weight w. capacity w, ees I= + oper | 
€ weight w; and value v; then the A,,= min [A,, + operations (m,, m,); A,, +P 






problem is to pack the Knapsack 

maximum total value is achieved. 
The problem is said to be 0/1 Knapsack 

the item from the list is either rejected or ee ° er 





(m, m,,)] 


in such a manner SO that a 






, 104” 
= min[1600 +(10 x 40 x 5), 800+ ( hp 
-=min [3600, 1000] lnp 


= 1000 












| 
2 
3 
4 
5 forj=1ton 
6 
1 
8 
9 


j 
(Z A= min[A,, + operations (m,, m,), A,, + operations * 


ni) = min[800 + (4 x 40 x 5), 


= min[1600, 1200] | 
= 1200 





(m,, m,) = ((m,, m,)'m,) 


= (m,, m,) = ((m, m,) m,)m,) 


6 Solve the following instance of LCS problem through 
dynamic programming 
- x = ABCDCDBCAD 


y = BACCDCABBD 


process is like this : 


LCS-LENGTH(X, Y) 
m= length[X] 
n= length[Y] 


‘fori=1tom 


do c[i, 0] =0 


do c[0, j] =0 
fori=1tom 
do forj=1ton — 
doifX;=Y, 
then efi, j)=c[i-1,j-1]+! 
bli, j] = ARROW_CORNER 
-~ else if c[i— 1, j]>= efi, j-1] 
‘then c[i, jJ=cfi-1,J] 
bfi, j] = ARROW_UP 
else c[i, jJ=cli,j-!] 
bfi,j] -ARROW_LEFT. 


Feturn c and b | 


"tX | ABCDCDBCAD 
"tY [BACCDCABBD : 






| [R.T.U. 2018, 2015] | 
——— . 

Ans. In our problem 

X= ABCDCDBCAD 

Y= BACCDCABBD 













Step ::X,='p! equal to Y="'D' ; 
Dita, 10] = T and c[10, 10] = 6+1=7 _ 


















line number 10 and 11 ; 

pT ee ae ee 10_ 
é EY A Se a BB] (CDI 

: «tol “Toyo at 8 
A, 0 Ol sifetfeifeifeifaif cifeiten 
2B ofa Tal tr] ptt a say eat oo 
3 C0 Tip tif x20 2} ea] x2[-2] 2] tal to 
4D ofhy TH pat to] <3] ses] cap ot a] 
SC ofM[ Ty <2[ x3] t3] safes] a] ea ce 
6 Dol ti] Tif fa Ta] <4] | taf tal tal fal <5] 
7 Both 2[ tsa) tal tapas ws] ts] 
)* Sofia raps test teh tet ts) 
9 2A ol Tif x2] t2] T3] ta] 15] <ofeeoieeel wo 
Jo Dol ti] t2f 2] t3] <4] ts] tol tol tol <7 





| OE 
Q.7 Explain and write an algorithm for greedy.method 
of algorithm design. Given 10 activities along with 
their start and finish time as 
S= {Aj Ay Ay Ay Ay Ag Ap Ay Ag Aig 
S;= {1, 2, 3, 4, 7, 8, 9, 9, 11, 12} 
F,= {3, 5, 4, 7, 10, 9, 11, 13, 12, 14} 
‘Compute a schedule where the largest number of 
activities take place. | [R.T.U. 2017] 





———— 
Ans. A greedy algorithm always makes the choice that seems 
to be best at that moment. This means that is makes a locally 
optimal choice in the hope that this choice will lead to globally 
optimal solution. 

In many problems, a greedy strategy does not in general 
procedure an optimal solution, but nonetheless a greedy 
heuristic may yield locally optimal solution that approximate 


| aglobal optimal solution in reasonable time. 


When we have to decide which choice is optimal, we 
assume that we have an objective function that needs to be 
optimized at a given point. A greedy algorithm makes greedy 
choice at each step to ensure that the objective function is 
optimized. The greedy algorithm has only one show to 
compute the optimal solution so that it never goes back and 
reverses the decision. 

For the given example, the greedy choice is to always 
pick the next activity whose finish time is least among the 
remaining activities and the start time is more than or equal 
to the finish time of previously selected activity. We can sort 
the activities according to their finishing time so we always © 
consider the next activity as minimum finishing time activity. 

S = {Aj, Ap, Az, Aq, As, Ags Az, Ags Ag, Ajo} 

S;= {1, 2, 3, 4, 7, 8, 9,9, 11, 12 } 
F,= {3, 5, 4, 7, 10, 9, 11, 13, 12, 14} 
Sorting according to F; 

S = {Aj, Ag, Ag, Ag, Ag, As, Az, Ag, Ag, Aro} 






(AA.20) 


1. Sort the activities according to their finishing time. 


2. Select the first activity from sorted array. 


3. Do following for remaining activities in sorted array. 
If the start time of this activity is greater than or equal 
to the finish time of previously selected activity: then select 


this activity. 
Schedule: 
Ay, As, Ay Ags Az Ag, Ato 
7 activities can be performed. 





a 
Q.8 Explain Matrix chain multiplication. Also find the 
parenthesization for the following matrix 


Al = 15x10, A2 = 10x20, A3 = 20x25. 


[R.T.U. 2016] 


Ans. Matrix Chain Multiplication : We have sequence 
(chain) <A,, A,,....A,> of n matrices to be multiplied and we 


wish to compute the product 
A,, A,A,.... A, 


A product of matrix is fully parenthesized if it is either a 
single matrix or the product of two fully parenthesized matrix 
surrounded by parenthesis, matrix multiplication is associative 


and so all parenthesization yield the same product. 


We can multiply two matrices A and B only if the number 
of column of A is equal to the number of row of B. If A js a 
px q matrix and B is a qx r matrix the resultant matrix C is a 
p x r matrix. The time to compute C is dominated by the 


number of scalar multiplication. 


Suppose that the dimensions of matrices are 10x100, 
100x5 and 5x50 respectively. If we multiply according to the 


arenthesization ((A, A,)A,) we perform 10100x5=5000 
‘calar multiplication to compute the 10x5 matrix to multiply 
his matrix by A,, for a total of 75000 scalar multiplication, 
imilarly, if we multiply according to the parenthesization 
A, (A, A;)) we perform total of 75000 scalar multiplication. 
‘hus, computing the product. according to the first 
arenthesization is 10 times faster. : 


Parenthesization of following matrix : 


A; =15x 10 
A, = 10x 20 
A; =20 x 25 
Firstly find vector d as: 


take row part of each matri 
d column parts of last matrix i.e, 25 " 


=e d-=(15, 10, 20, 25) 


For diagonal s = 1 


Mj 4; = m[i,i] + mli+Li+l]+d,, dj di,,i=1,2 


=> m,) =0+0+15x10x 20 
= 3000 

When i= 1 

M3 = M2 + M33 +d,d.d, 

When i=2 


=0+0+10x20x25 
= 5000 : 
Similarly, we find the value for whole table of 


m 





Fig. General structure of table 
Now, we will calculate min m for.m,, 


M3 = Mj; + M3 + dodid, 
= 0+ 5000 + (15x10x25) 
= 8750 
At each stage of parenthesization v, calculate th 


minimum scalar multiplication and is added to obtain the Sni 
matrix value. : 





Fig. Table after filling values of m. 





Q9 Solve the following optimal merge pattern probles 


; 4,8 
using greedy approach 5, 4, 7, 2, 9, Te rus 





Ans. Greedy method to solve optimal merge pattem 
Step 1 : Sort the files in increasing order of lengt a [atl 
Step 2 : Merge first two files, replace them with 125° 
file in list. 

Step 3°: Repeat from step/till list has only one file. 
Step 4 : Exit. | . 


Given: 5,4,7,2,9, 11,4, 8 
5 


Step 1: Sorting array : 2, 4 4, 5,7, 8,9, 11 J 
Merge first two :2+4=6,4,5, 75 8,5! 
Step 2: Sorting array : 4, 5, 6, 7, 8, 9, 11 
Merge first two : 9, 6, 7, 8, 9, 11 


B.Tech. (V Sem.) Cs, Sol 
. ved 
M2 = Mj; +My + dodjd> = 


{ 


of Algorithms 
(Ce Sorting array : 6,7, 8,9,9, 11 


sep > Merge first two : 13, 8,9, 9, 11 

Sorting array : 8,9, 9, 11,-13 

Merge first two : 17,9, 11, 13 

Sorting array : 9, 11, is, ij 

Merge first two : 20, 13, 17 

Sorting array : 13, 17,20 

Merge first two: 30,20 | 

Merge the Last two : 50 

Total no. of operations :6+9+ 13+ 17+20+30+50 
= 145 


sep a; 
step 5 * 
step 9 * 


0.10 Consider a knapsack of capacity 10 and items Prices 
as (40, 30, 20, 50) and weight (6, 4, 6, J). What is 

the maximum profit that can be earned if fractional 
items are allowed. [R.T.U. 2015] 

——$—_—_—  ——_—_—_—_—_—_—_—_—_—_————————————— 

Ans. v=(40, 30, 20, 50) 

: w=(5, 4, 6, 3) . 

Capacity = 10 

* Number of items, n = 4 

Initializing, x = {0, 0, 0, 0,}, Profit=0 


=n {0 2s 
oe 5° 4’°6°3 


= {8, 7.5, 3.33, 16.66} 
Arranging in descending order : 

's= {16.66, 8, 7.5, 3.3} 
According v = {20, 40, 30, 50} 
w= {6, 5, 4, 3} 

ori= 1, check w[i] <=M 
6<=10 yes. 

x{i] = 1, M=M-wi{i] = 10-6=4 
for i=2, w[2]<=M 

5<=4, no. 

Iteration stops 

Check, is i<=n, 

2<=4, yes 


Hence, vector is [1, 0.8, 0, 0] 

Total profit = 20 x 1 +40 x 0.8+0+0 
=20+32=52 . 

divide and 


; ; i nd 
Qui Compare dynamic programming an [R.T.U. 2015] 


Conquer approach. 
. OR i 
What is the difference between divide and conqu 


: ? Explain with 
se nial programming method : rus 2014) 
mple. - 





—_A27) 


Ans. Difference between divide and conquer and dynamic 


Programming method 
l. Divide and conquer work by dividing problem into 
Sub-problems, conquer each sub-problem recursively and 
combine these solutions. 

Dynamic programming is a technique for solving 
problems with overlapping subproblems. Each sub-problem 
is stored only once and the result of each sub-problem is stored 
in a table (generally implemented as an array ora hash table) 
for future references. These sub-solutions may be used to 
obtain the original solution and the technique of storing the 
sub-problem solution is known as memorization. 

Dynamic programming = recursion + reuse 
2. — Individe and conquer, the sub-problems are independent 
of each other while in case of Dynamic programming, the 
sub-problems are not independent of each other (Solution of 
one sub-problem may be required to solve another. 
sub-problem) 

3. Divide and conquer does more work on the sub-problems 
and hence consumes more time. Dynamic programming solve 
the sub-problems only once-and then stores it in the table. 

4, Example of divide and conquer is merge short, binary 
search. Example of dynamic programming is matrix chain 
multiplication. 

Example : A classical example of divide and conquer is the 
merge sort algorithm, where you divide the array into two 
halves (disjoint halves so they are independent) then sort and 
merge them. At each level of division of the array, the parent 
array is divided into two disjoint children arrays, so the elements 
in any division never overlap, or the arrays to be stored never 
overlap. 

For the dynamic programming example, a classic 
example would be a little tedious to understand, so we would 
rather put up a minimal but simplistic one. 

Consider the N* term of the fibonacci sequence given 
by the relation : f(n) = f(n—1) + f(n— 2) with [f(1) = 0, f(2) = 
1]. In order to compute recursively, f(4) the algorithm break 
the problem into two sub-problems namely f(3) and f(2). Now 
we know that f(2) = 1, so this result is stored in a table. 
Further, in order to recursively compute f(3) = f(2) + f(1), 
again f(2) is required to be computed, an overlapping sub- 
problem. This time instead of computing it again, the result is 
looked from the table and returned. . 
a ——S?:°—ONONDnRNan@wa>*™@@m=— 


‘| Q.12 Find optimal solution to the knapsack (0,1) instance 


n= 7, m= 15, (Py P2-+-P7) = (10, 5, 15, 7, 6, 18, 3) 
and (W, Wz.0.W7) = (2, 3, 5, 7, 1; 4,1) [R.T.U. 2013] 


—————————e—e—————— 0 OO 


Ans. n=7 

m=15 

(P}, Pa» P3---P7) = (10, 5, 15, 7, 6, 18, 3) 
(W), Wz, W3---W7) = (2, 3, 5,7, 1, 4, 1) 


Optimal solution using knapsack (0, 1)=? 


Step 1: Find = for all instance i = 1 to 7 


m_10_, 
w, 2 
Pe -3 1.66 
w, 3 
Ps _15_, 
w3. 5 
Pe a] 
Ww, 7 
is 
Ws l 
De cas 
We 4 
Pr 3 4 
w, | 


Step 2 : Arrange in decreasing order 


| 6 | 5} 4.5} 3] 3 | 1.6] 1 |P;/W; (in decreasing order 
Fit2}4}s5fif3[7] Weight CS 


Step 3 : Include items in above order (generated in step2) till 
now capacity <=m 
Weight Profit 

3 

15 

18 

10 

: 6 

' Capacity utilized =1+2+4+5+1=]3 
Total profit,,,, =6+ 10+ 18+ 15+3=52 
M after capacity utilized = 15-(1+2+4+5+ 1)=2 


— 


NY kw os 


OT 
Q.13 Let w = {4, 6, 7, 8} and m = 18. Find all Possible 
subsets of w that sum to m. Draw the state Space 
tree that is generated. ‘ [R.T.U. 2013] 


ee 
Ans. The subset of w which makes the sum 18 are (4, 6, 8) 

The solution vector in fixed-size for these solutions is 
1, 1, 0, 1). The part of search tree, i.e. the actual tree for the 
lution vector is as shown in figure. 


» A 


is of Algorithms 
rac the min heap steps are as follows - 
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Pa 






w, = 0-7 
w,20, eh w= 
@ Q 


w, = 0/ \w, = 1 Ws = 0% 


° 9) @ - OD - @ 
> 


ll ll 7 
a eat eee, eee 
w/ l_ 7 ls 3/ 


a ish is? 7 oe] eA est 
) 08 OB 6H OW O8 OOH 
ig. 
The solution vector includes the node 1, 3.5.5 
This solution vector is shown by thin line and rest of the ci 


are dash line in the search tree. 
Similarly, other solutions can be found out by tracing 


the search tree. 


ee PT I a PI 
Q.14 Find the optimal merge pattern for the given values 
35, 15, 20, 40, 10. [R.TU. 2013 
Vee SS 
Ans. (35|15|20| 40,10) 
a{!] a[2] a[3] a[4] a[S] 
Now elements a[1] and a[2] are merged to yield 
(15, 35] 20|40, 10) . 
Then a[3] is merged with a-[1 : 2] 
(15, 20, 35 | 40, 10) 
Next, elements a[1:3] and a[4:5] are merged 
- (10, 15, 20, 35, 40) : 
The algorithm is given by 
1 merge sort (low, high) A 
2 //a [low: high] is a global array to be sorted. 
3 // small (p) is true if there is only one element. 
4 // to sort. In this case the list is already sorted. 
4 , ; 
6 if (low <high) then // if there are more than one elemet! 


8 // Divide p into sub problems 
9 // Find where to split the set 
10 mid: = [(low+high)/2]; 

11 // Solve the sub problems; 
12 Merge sort (low, mid); 

13 Merge sort (mid + 1, high); 
14//Combine the solutions. 

: ia (low, mid, high); 


17 } 


+g he 
Q.15 saree the operation of construction of min # 
ree ri Siven values 10, 20, 30, 1, 2; gro. 


’ 


Ans. Given values - 10,20, 30, 1.2 3,4, 11,2131 





fo 
0 insert 10 
j 

Insert 20 
(i) Insert 30 


(vi) Insert 3 








° +> 


(vi) Insert 4 


(ix) Insert 21 


(x) 








(xi) Insert 41 





a ———____—_+4 
Q.16 Find optimal solution for given data by Knapsack 
problem. 7 
P,, P, P,) = (5, 2, 2, 4, 5) an = 12. . 
Set acnece [R.T.U. 2012] 


oo 0e 
} ‘Ans. To solve this problem, we use some strategy to determine 


the fraction of weight which should be included so as to 
maximize the profit and fill the Knapsack. 


(Xj X_ X3 X4X5) LXW) EPIX; 


can m 
: 22 22 -| 3.51 10.76 
(i) ( 25? a? 4) 


Now taking maximum profit 5 with weight 5 and 1. 
x=X5=1, Dwjxj <M 


1 1 


l1lay 29.44 
(iii) (upg) 8.6 2 





¥ 
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(= Thus, at this step updated sets are 

























Thus, at this step eae sets are Zen (ly 5), (4, 7), (5,7), (S, 6), (2, 3), (6, 8), (5,3 (v) Next element is7 © - 
(iv) (13.un1] 12 36.66 {(1, 5), (4, ), (2); (3), (6), (8)} Adding all other edges namely, £2, A : : 
Step 3 : Next edge with minimum weight is {5, 7} will result in cycle formation hence not added to fa 


At each step, we try to get maximum profit. The 


maximum profit we get by ; 
(iv) x,=1, x,= 1/3, x,=1, x,=1, x= 1. These fractions of 
weight provide maximum profit. 


1} go, the tree obtained is a minimum spanning tree 











Q.17 Trace the Kruskal’s algorithm to obtain minimum 
spanning tree from the graph. 


So, A=AvU {5,7} 
Thus, at this step updated sets are : 


m2 @ ®B 








{(1, 5), (4, 7), (5, 7), (2), (3), (6), (8); Shifting . 
So, this can also be written as : 5) @ 2) 
{(, 25 7, 4), (2), (3), (6), (8)} because thes tts . 
addition does not form a cycle .! : Tw 
oie e's bes Minimum Cost = T 
Step 4 : Next edge with minimum weight is {5, 6} ° y,veT 
| =5+25+40+20+30 +15+10 
= 145 20>17 
—>- 
Shifting 








Q18 Ilustrate the operation of heap on following array: 
A = <5, 13, 2, 25, 7, 17, 20, 8, 4> [R.T.U. 2011] 





So, ~A=AvU {5, 6} 

Thus, at this step updated sets are : Ans, Creation of a Maximum heap 
{(1, 5), (4,7), (5, 7), (5, 6), (2), (3), (8)} (i) First element is 5, take it as root. 

[R.TU. 2011] | Step 5 : Next edge with minimuin weight is {2; 3} 











Ans. To obtain the minimum spanning tree form the @)G) (Next element is 13. Make it as left child of root node and 
graph, steps are as follows: compare that whether the element inserted is smaller than 
So, A=AU {2,3} the parent node or not, then this element should be shifted 





St ‘ ; ss aes ts : ; 
bse cae Auraria weight is {1, 5}. So this edge ~ Thus, at this step updated sets are : with the parent node. 
S {(1, 2); (4, 7), (5, 7), (5, 6), 2; 3), (8)} ‘ 
tep 6 : Next edge with mini ight is {6, 8 
g minimum weight is {6, 8} Since 13>5 
©) After shifting 
So,  A=AU {1,5} ara 3000 7 (ti) Next element is 2 : 
Thus, at this step updated sets are Ray . () | 
Step 2 : Next Sas eh (3}, {4}, {6}, {7}, {8} SA 
+ Next edge with mini ioht i > =AU {6,8 
imum weight is {4, 7} Thus, at thi oe . (iv) After performing maximum heap operations, the 
. a) » at this step updated sets are : 68) ©xt element is 25. array looks like this 
| {(1, 5), (4, 7), (5, 7), (5, 6), 2,3) 0 cee eee 
° ‘ Step 7: Next edge with minimum weight is {5, 4} but ee _ 25 [os T 13 7 20 Te 777277 15 7 4) | 2y | 8 7 |. 2 7 1.5 
G) . | | it will form a cycle so cant be added, Next edge {5 }w GY >) 5) (13) (2) Now, we exchange the first element with the last 
can be added without forming a cycle. 25>5 25 25> 13, element. Heap size decreases, it contains only 8 nodes now. 
So, A=AU {4,7} 40 Shifting © Shifting GB) Heapify as root 


So, A=AU {5,3} 









ais Pole 2 ris es) (20 [os [a7 Ts 17 12 [a Ts 125 | 


The root value floats down to node 7 and second 
largest element reaches the root. Remove this by exchanging 
with last leaf (which is now at position 8). Heap size decreases, 
now it is 7. 





—, U7] 13 [5] 817] 2] 4 [20] 25 | 


Now next we exchange node | with node 7. Reduced 
heap size to 6. 


o . 
Sf YD) Hearing @ 
®O2 @OO04 | | 
381s T4773 era 


Next iteration exchange node 1 with node 6. 


(2) - 38 (8) 
(8) (5) Heapify (2) Ome © v3) 
O @ ® @ OnOn 


. GREE RTs 


Next iteration, exchange node 1 with node 5, 
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Next iteration, exchange node 1 with nog. TR 






= 
Heapify 
2) 


ESE EA RAEN AE 


In the last iteration, node 1 is exchanged with 
It is now included in sorted array. We do not need any it 
for last node since it is already in its sorted position, 


po je Ps pet § [| Tar 


[=] 


Node), 
Cration 


Q.19 X = <a, a, b, a, b>, Y = <b, a, b, b>. If Z is an 1c 
of X and Y, then find Z using dynamic 
programming. [R.T.U, 2011] 





Ans. Here X = <a, a, b, a, b> and Y= <b, a, b, b> 
m = length (X) and n = length (Y) 
m=5,n=4 
Now, filling in the m x n table with the value of cf 
and the appropriate arrow for the value of b{i, j J. Initializ 
top row and left column to 0. 


Work across the row startin g at the row] and colum 


from | till end. 
For every box, check x; = y; re 

e — Ifyes, then fill in the value equal to diagonal neighbo 
value + 1 and mark the box with the arrow "\". 
¢ — Ifno, then compare values in the box above #" 
box to the left and fill in the box with the 
Put arrows according to from where the a 
derived. If c[i— 1, j) > cfi, j— 1] then b[i, j] em" 


_ otherwise “<_” 
Here , 
xX, = a y} =b 
X,=a y2= a 
X4= a y. = b 
4 


Now, fill the value of c[i, j] in m * n table. 
Initially, . 

fori=1 to 5, ofi, 0] =0 
forj=0 to 4, c[0, j] =0 


—@ SF Wy 
| SERUETE TE. | 
Next iteration, exchange node 1 with node 3 25 


om is 2 
: i a 





Ar WN KH OO = 
srr TF PDP wD KM = 


Now, for i = 1 andj = 1, we check x, and Y}, We get . 


ie.a#b 
Heyy ofi—1,j] =[0, 1]=0 
efi, j- 1] = [1, 0]=0 
Thatis c[i—1,j] =c[i, j—-1]=0and bf1, 1] «t” 
Now, i=1landj=2 
Check x, and y>, we get x, = y, 
efi—1,j] =[1-1,2]+1 
=0+1=1 
c[1, 2] = 1, b[1, 4] HK 
Similarly we fill all values of c[i, j] and finally we get, 
0 1 2 3 4 


a 
oo ce 
a 

. 


ete itr | Ya 


The entry 4 inc [5, 4] is the length of the Z. and the final 
output of Z is ° ‘ 
Z=<a,b, b> 
oo ___—_— 
220. Find minimum spanning tree of the following graph 
using Prim’s and Kruskal’s method. 

















[R.T.U. 2010, Raj. Univ. 2006,2004] 
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Ans. Kruskal’s Method : Minimum spanning tree using ° 
Kruskal’s method : 7 - 





Edge is selected in such a manner that it contains a 
minimum weight and adding to ‘M’ does not includes any 
cycle. 


Q) @—__@ . 
2 @—1_@—2_ _@ 
@ @—_+_@—2 © 





(5) We will not add next 4 weight edge 2 to 5 to ‘M” 
because by adding this will get the closed paths. 


(6) We will not add 5 weight edge S to 3 to ‘M’. 

(7) We will not add 6 weight edge 4 to 2 to ‘M’. 
(8) So as above we will not add 6, 7 and 8 weight edges 
to ‘M’. 

Prim’s Method : We start from source node and add 


the edge to ‘M’ which is having the least weight among the 
edges connected to that node. And that will not make a closed 


path. 








See ll 
Q.21 What is Dynamic programming? How it gives the 
optimal Solution? 


= 3, consider M = 6, (wl, wa, w3) 


(pl, p2, p3) = (1,2,4) 
Find optimal solution for given knapsack problem. 


B.Tech. (V Sem.) C.s. Soivey 
What is dynamic programming ? HG. xO 
optimal solutions? t Bing 


OR TR, Ty, iy 
Discuss Knapsack problem with respecy ™ 


programming approach. Find optima] sof wat . 


given problem, w(weight set)={5, 10, 7 5, a6 fy 


size O, knapsack is 8. Qng 
ize of IRTy, 2iy 


Consider n = 3. (Wy Wy Wy) = (2, 3 


ret 
= (1, 2, 4) and m = 6. Find optimal sae Pe + 
6 


given. data. Rey 


——— ——— 
Ans. Dynamic programming : Dynamic programms S 


STaMMing ; 
an algorithm design method that can be used when the solu N 
to a problem can be viewed as the result of a sequence 
decisions. 

Dynamic programming is the most powerful des 
technique for optimization problems. The solutions fo, the 
dynamic programming are based on multistage Optimizing 
decisions, on a few common elements. 

Dynamic programming is closely related to divide ang 
| conquer technique, where the problem breaks down into smally 
subproblems and each subproblem is solved recursively, The 
dynamic programming differs from divide and conquer ing 
way that instead of solving subproblem recursively, it solves 
each of the subproblem only once and stores the solution to 
the subproblems in a table. Later on, the solution to the mai 
problem is obtained by these subproblem’s solutions. 
Optimal Solution for knapsack problem : For m= 6 and 
n=3, table will contain n rows and w columns. 

i will vary.from to 1 ton 
_ wwill vary from 1 tom 
Step 1. 





0 1 2 3 4° 5 


i 
cll - 
Magy My fl pe 
oy“, 










N 


Ww NOs — oO 


c[0, w] — 0 Lia 
c{i,0) <0 fori=1ton 
Step 2. For i= 1, check for each value of w 
For w= 1, w, = =2 and w,>Ww 
So, ¢fl, 1] = ofi-1, w] = = c[0, w] =9 
For w= 2,W, =2 , 
and w= w, w—w, =0 
Check if y oa 0]>c [0, 2] 
Or 1+0> 
So, cf[l, = v,+c[0,0])=1 — 
For w = 3, W, <W, W- w, = 
v, +c [0, 1] >c [0,3] 
1+0>0 . 





Algorithms 

e[1, 3] =vi + ¢ (0, 1] 1 * 

=4,w, <W,W- Ww, =2 

c(t a= vito 2] 
+0= 


A x 
Ber wo 
So, 


w= 5,¥, <W, W—w, =3 


ef S)=%i + C10, 3] 
, =1+0=1 


For w= 6, Ww, <W, W-w, =4 


go, oll, 6l=vi + (0, 4] 
So, the updated table for rowi=1 is’ 
w 1 2 as 4 ; : 






hs WE. WH WE, 
es 
COW la a 


Step 3- For i= 2 check for each value of w 
For w= 1, W, = 3, W. > W, W—- Ww, =-2 
S, ¢[2,1)=c[1,1]=0 
For w = 2, W, = 3, W, > W, W— Ww, =~ 1 
So,” ‘ c[2, 2] =c[1, 2] =1 
For w= 3, W,= Ww, W— Ww, =0 

v,+¢[i-1,w-w.]>c[i-1, w] 
ois 2¢e[l, 0]>¢[1;3] 

2+0>1 
So, ,.. ¢ [2,3] =v, 7 [1, Oo] 
=2+0=2 
Pre dv wend we w,=1 

v,+e[l, 1]>e [1,4]. 








wo we =| oo 


‘OF 20> 1 
So, ¢[2,4]=v,+c[I1, 1] | 
. =2+0=2 
For w.= 5, w, < w and w - w, = 2 
Vv, t¢[1, 2]>¢ [1,5] 


or 2+1>1 

So, ¢f2, 5] =v, +e [1,2] 
=2+1=3 

For w = 6, w, < w and w- w,=3 

v,+¢[1 ,3]>c¢[I, 6] 

M0 2+ 1S) 

So, ¢[2, 6]=v,+c[I, 3] ° 
=2+1=3 © ; 

So, the updated table for row i=2 1s 


Ww <r ag 
<0 1 2 3 4 5 6 


Li, VA lay GZ 
ena er 
LA 

Vk Wl Hl la —\\, 













wo re —- O&O 


wen = & 





WA 


VA, Vk, Wa, Ula 
77 DA. Wha W#A_§_ 


Step 5. After computing the table, all we need to do is find 
out the optimal solutions i.e., the items to be put into knapsack. 





Step 4: For i = 3 check for each value of w 
For w = 1, w, = 3 and w, > w 
So, ¢[3,1]=c[i-1, w]=e(2, 1]=0 
For w= 2, w,>W 
So, ¢ [3,2] =c [i-1, w]=c [2, 2]=1 
For w= 3, Ww; =w andw— w, =0 
v,+e fil, w-—w]>c [i-1, w] 
or =v; +¢ [2, w—w,] > ¢ [2, w] 
or 4+c (2, 0] > [2, 3] 
or 4+0>2 
So, c[3,3]= v, +e [2,0] 
_=4+0=4 
For w = 4, w, < w-and w - w, = 1 
v, +¢ [2, w- w,} > [2, w] 
or 4+c[2,1]>c [2, 4] 
or 4+0>2 
So, c[3,4]=v,+c [2, 1] 
=4+0=4 
For w = 5, w, < w and w- w, = 2 
v, + ¢ [2, w— w,] > ¢ [2, w] . 
or 4+¢[2,2]>c [2,5] 
or 4+1>3 
- So, c [3,5] =v, +c [2, 2] 
; =4+1=5 
' For w=.6, w, < w and w- w, =3 
v, + ¢ [2, w—w,] > [2, w] 
or 4+c[2,3]>c [2, 6] 
or 4 423° 
So, c[,6]= v, + ¢ [2, 3] 
=4+2=6 
The updated table of is 
= 0 1 2 3 4 5 866. 








o WA > WL Lay i ll | 


Ez 
VA.’ WL WL 






Check starting from [3, 6] 


c [3, 6] # ¢ [2, 6] so, item 3 is part of Knapsack. 
_ Now'check for c [i- 1, w— w\], #e., 

c [2, 6—w,] orc [2, 3) 
~ we can see that ¢ [2, 3] #¢ [1, 3] 


So item 2 is part of Knapsack 
Now, w=w-w,=3-3=0 


So, 


w= Oandi=i-1=0. ° 


Thus, w=0 andi=0 and algorithm ends. 
Finally we have item 2 and 3 in‘the Knapsack with 


ue=2+4= 6: This is an optimal solution. ~ 





[ AA.30) 
Optimal Solution : Given weights and values of n items,we 
put these items in a knapsack of capacity w to get maximum 
total values in knapsack. 
Ex. Value [] = {60, 100, 120} 
Weight [] = {10, 20, 30} 
w=50 
w = 10, value = 60 
w= 20, value = 100 
w = 30, value = 120 
w = (20 + 10), value = (60 + 100) = 160 
w = (30+ 10), value = (120 + 60) = 180 
w = (30 + 20), value = (100 + 120), = 220 
w=(10+20+30)>50 
Solution =2 <0 
In the given problem, only weight array is given, not 
value array, so we cannot solve the given knapsack problem. 








Q.22 Discuss Dynamic programming solution to longest 
common subsequence problem. Write an algorithm 

‘to compute an LCS of two given strings.[R.T.U. 2017] 

OR 
Write the short note on Longest common 
subsequence. . [R.T.U, 2010, Raj. Univ, 2004] 
OR 

Write an algorithm for finding LCS. 
_———————— 
Ans. In the longest common subsequence problem, we 
are given two secuences X =(x,, Xp... Xm) and Y=(yj, yo, ... Y,) 
and we have to .:ad a longest common string S. Common to 
_ both the sequence using dynamic programming. 

Step 1: Characterizing a longest common 
subsequence : A brute-force approach to solve the LCS. 
problem is to enumerate all subsequences of X and check 

. each subsequence to see if it is also a subsequence of Y, 
keeping track of the longest subsequence found. Each 
subsequence of X corresponds to a subset of the indices 
{1, 2, ... m} of X. There are 2™ subsequences of X, so this 
approach requires exponential time, making it impractical for 
long sequences, - 

The LCS problem has an optimal-substructur 
as the following theorem shows. As we shall see, a ele 

Classes of subproblems correspond to pairs of “prefixes” of 
the two input sequences, To be. precise, given a sequence X 
= (X), Xz, «.., Xm), We define the jt prefix of X, fori=0. | m 
as X\= (Xt, Xp .. X). For example, ifX =(A, B, C.B, D A,B), 
then X,=(A, B, C, B) and X, is the empty sequence. _— 

Theorem (Optimal substructure of a LCs) : Let 

X= (Xj, Xzy «. Xq) and Y = (V1 Yop «+s Yq) be sequences, and 


let : Bx Pe cits *) be any LCS of X and Y. 
my then = = i 
25 i A 4% =X, = y,, and Z,.1 isa LCS of Xnvl 





‘the LCS has length 0. The optimal substructure ° 


B.Tech. (V Sem.) Gs, Son 
DIE Xm # Yq then % # Xm implies that 77> 
X., and Y. : Sale 


§ 
3. 1f xX, # Yp then a # y, implies that Z i, " 
and Yp.1- , 2L¢g 

Proof (1) If z, #. X,,, then we could append F 
to obtain a common subsequence of X anq Yo Fe ip 
contradicting the subposition that Z is =a 
subsequence of X and Y.. Thus, 
Zk = Xm = Yn ; 

Now, the prefix Z,-,; iS a length (kx : 
subsequence of X,, ; and Y,_1. We wish to Show ott 
LCS. Suppose for the purpose of contradiction that at it; 
common subsequence W of X,,_, and Yi-1 With len Tey 
than K—1. Then appending x,, =y, to W Produces q 
subsequence of X and Y whose length is greater iia 
is a contradiction. K ig 

(2) If z, # x, then Z is a common Subsequence of 
and Y. If there were a common subsequence W of x 
Y with length greater than k, then W would also be aco, i. 
subsequence of X,, and Y, contradicting the ASSUMption ty 
Z is LCS of X and Y. 

(3) The proof is symmetric to (2). 
__ The characterization of theorem shows that LCS oft 
sequences contains within it a LCS of prefixes of the tho 
sequences. Thus, the LCS problem has an optimal 
substructure property. A recursive solution also has ty 
overlapping-subproblems property. | 

Step 2 : A recursive solution : Theorem implies tht 

there are either one or two subproblems to examine wis 
finding a LCS of X =(x,, x, ..., Xn) and Y = (yj, Yo, Yl 
Xm ~ Yn» We must find a LCS of X,,_, and Y,, ,. Appendit 
Xm = Yn to this LCS yields LCS of X and Y. If xq, # Yo 
we must solve two subproblems: finding LCS of Xp. 2! 
and finding LCS of X and Y,,_,. . 


Oty 


Wwe m 


Ust hay 


y 


Es 


Whichever of these two LCSs is longer is the LCS). 


and Y. Because these cases exhaust all possibilities, we kot 
that one of the optimal subproblem solutions must oe 
within LCS of X and Y. | 
___ Wecan readily see the overlapping-subproblems nett 
in the LCS problem. To find LCS of X and Y, we may? cd 
find the LCS of X and Y,-1 and of X,,_, and Y. But ics! 
these subproblems has the subproblem of finding ihe 


X,,-) and MY a! 

As in the matrix-chain multiplication P 
recursive solution to the LCS problem involves €s!4 
recurrence for the value of an optimal solution. Let ; dy 
C[i, j] to be the length of the LCS of the sequences ath 0,9 


feither i= or J =0, one of the sequences has we ie 


o 
plem, 
re lishisl! 


Problem gives the recursive formula. 


: consider 


Algorithms 
€ , 0! ifi=Oorj=o, 


c{i-1,j-1]+1 if, j>Oandx, =y. (i) 
max(c[i, j-1], c[i=1, j]) if i, j>Oandx, sy, 
, 


pserve that in this recursive formulation, acondition in 

~  plem restricts which subproblems we may consider 
the Ph yp we can and should consider the subproblem of 
fing the LCS of X; and Y; ,. Otherwise, we instead 
the two subproblems of finding the LCS of X; and 


of Jd = 


and of X;-1 and Yj; 


‘ibe ding the LCS is not the only dynamic programming 


orithm that rules out subproblems based on conditions in 
problem. For example, the edit-distance problem has this 
characteristics. | 
Step 3 : Computing the length of LCS : Based on 
jon (i), we could easily write an exponential-time recursive 
algorithm to compute the length of the LCS of two sequences, 
since there are only ©(mn) distinct subproblems, however, we 
can use dynamic programming to compute the solutions bottom 


2 Procedure LCS-LENGTH takes two sequences 
X= (Xj, Xp, «++» Xm) and Y = (yj, yo, -.-5 Y,) aS inputs. It stores 
the c[i, j] values in a table c(0, .. m. 0. . n] whose entries are 
computed in row-major order. (That is, the first row of c is 
filled in from left to right, then the second row and so on). It 
also maintains the table b[1... m, 1...n] to simplify construction 
of an optimal solution. Intuitively, b[i, j] points to the table 
entry corresponding to the optimal subproblem solution chosen 
when computing c[i, j]. The procedure rettims the b and c 
tables; c [m, n] contains the length of the LCS of X and Y. 
LCS-LENGTH (X, Y) 

* m< length[X] 

n < Iength[Y] 


for i<— 1 tom 
do c [i, 0] <= 0 
forj <—Oton 
do c[0, j] <0 
fori<1tom 
do forj<-1ton 
do if x;,=y; 
10° then eff) efi~1.j- 1141 
Mo be eN” 
a else if c[i—-1,j] > cfi,j— 1). 
13> then [i,j] <cli- LJ] 
blige ™ 
15 else cfi, j] <i, j-1 
16 | bli, jl << “—” 
17 return c and b 


No - eo, ee SO OC Oe ony 


The c and b tables computed by 
; = A, B, 
“tuences X= (A, B, C, B, D, A,B) and ¥ = (Bs Ds © 


LCS-LENGTH on the 





A). The square in row j and column j contains the value of 
cli j] and the appropriate arrow for the value of b[i, j]. The 
entry 4 in c[7, 6] - the lower right-hand corner of the table is 
ine length of an LCS {B, C, B, A} of X and Y. For i, j > 0, _ 
entry c[i, j] depends only on whether x; = y; and the values in 
entries c[i— 1, j], efi, j — 1], and c[i— 1, j — 1], which are 
computed before c[i, j]. To reconstruct the elements of aLCS, 
follow the b[i, j] arrows from the lower right-hand-comer; the 
path is shaded. Each “.” on the path corresponds to an 
entry (highlighted) for which Xi=Y; is amember of an LCS. 


i 22s 4S © 










polo} o 

folet apn ape 
2 Go [Niel] Am [R] 2 

5 ©/0 [i]t N2] 2. ot] 24} 

4 @/ 0 [Ni] 14) otf ot]Sa[ 3) 

5 D| 0 [14 /X2| 2 

Gh [it] 2 anfs3] a 

7 BLo |S] 24 2t/t3)%a]t4 

: Fig. 

Figure shows the tables produced by LCS-LENGTH on 
the sequences X = {A, B, C, B, D, A, B} and 
Y = {B, D,C, A, B, A}. The running time of the procedure is 
O(mn), since each table takes O(1) time to compute. 

Step 4: Constructing a LCS : The b table returned by 
LCS-LENGTH can be used to quickly construct LCS of X = 
(X}, Xp, «+» Xp) and Y = (yj, Y2, ---> Y,)- We simply being at b 
[m, n] and trace through the table following the arrows. 
Whenever we encounter a“ “in entry b[i, j], it implies that 
x; = y; is an element of the LCS. The elements of the LCS 
are encountered in reverse order by this method. The following 
recursive procedure prints out LCS of X and Y in the proper, 
forward order. The initial invocation is PRINT-LCS (b, X, 

length[X], length[Y]). 

PRINT-LCS(b, X, i, j) 

ifi=Oorj=0 
2 then return 

3 ifbfi,jJ=“X\” 

4 then PRINT-LCS(b, X, i- 1, j-1) 
5 print x; 
6 

7 

8 


= 


elseif bfi,jJ=“T” 
then PRINT-LCS(b, X, i- 1, j) 
else PRINT-LCS(b, X, i, j— 1) , 
For the table in this procedure prints “BCBA.” The 
rocedure takes time O(m + n), since at least one of i andj is 
decremented in each stage of the recursion. 





Q.23 Explain Prim’s algorithm for finding — 
spanning tree. [R.T.U. 








OR . 
Find minimum cost spanning tree by implementing 
prim’s algorithm for given weighted graph. - 





Fig. 


[R.T.U. 2014] 





Ans. Minimum Spanning Tree . 
The MST problem is to find a tree T of a given graph 
G that contain all the vertices of G and has the minimum total 
weight of the edges of G overall such tree. 
Prim’s algorithms 
Prim_MST (G, V, r) 
// Given a graph G , vertex set V and root vertex r 
// Uses array key and x 
: For each vertex v in V; 
: Key [v] : = «; // set key to initial value; . 
: II [v] :=null; //set parent of every vertex to NULL; 
: End for; 
? Key [r] : = 0; //key of root vertex is Zero; 
: Make a priority queue Q of all vertices; 
: Select vertex with minimum key field 
u:=min(Q); 
: For each vertex v adjacent to U; 
: If weQ and w(u, v) < key [v]; 
Step10:T[v]:=u; 
Step 11 : Key [v] : = w(u, Vv); . 
Step 12 : End if: 
Step 13 : End for; 
Step 14 : If Q not empty, goto Step 4; 
Step 15 : Exit. 
Working Rules for Prim’s Algorithm 
1. Start with an vertex u (assumed). 
2. Now select another vertex such that edge is Created from 
u and v and is of minimum weight then connect uv and 
add it to set of vertex v. , 
. Now among the set of all vertices find other vertex V, that 


is not included such that (v,, v,) is minimum labeled and 
add it to V. 





Step 1: Start with a vertex, here for the give 
start from vertex a. 


. (a) Starting vertex 
Step 2: Now, select another vertex v such that ed 
from u and v and is of minimum weight . 


” raph we will 


Be is createg 


u=a 
v= then weight =13 
v=c then weight =8 
v=d then weight = 1 


that is we get minimum weight 1, therfore connect 
uv and add it to set of vertex v. 


(2) 
@ 


Step 3: Among the set of all vertices find other vertexy 


that is not included such that (v,,v,) is minimum labeled 
and add it to v. ae 


min (ac, dc, de, df) 


= min(8,5,4,5) 
=4=de 





minimum edge, : 


_minimum cost So 











se Algorithms 
gee? Lea till we get MST. ; a 
ep or m= {m(i, k) + m(k + 1, j)+P;_,, Py P3} forisk <j 
Vnin(dc,4f ef; ec) Now, 
lsk<2 
min(5,5,2s3) my = mI, 1] + m[2, 2] + PoP,P, 
=0+0+(4x16x10) - 


=2=ef 
= 640 ; 
| 2<k<3 | 
m , = m[2, 2] + m[3, 3] + P;PP; 
=0+0+(16 x 10x 8) 





P = 1280 . 
3<k<4 
m3, = m[3, 3] + m[4, 4] + PPP, 
m0 =0+0+(10 x 8 x 20) 
= 1600 . 
As we have seen that the above tree does not have all eiek<s . 


‘ No 
connected vertices so we have to move futther to get k=1 my =m], 1]+m[2,3]+ PPP; 


0+ 1280+ (4 x 16 x 8) . 
1280.+512 
=1792 
= m{l, Zi + m{3, 3] + PoP2P3 
=640+0+(4*10x8) | 
= 640 +320 
. = 960 
Now, 2<k<4. . 
k=2 my =m[2, 2]+m[3, 4]+P,P2P, 
= 0+ 160+ (16 x 10 x 20) 
= 160 +3200 
= 3360 
k=3 my =m[2, 3] +m[4, 4] + P,P5P, 
= 1280+0+(16x8x20). _ 
= 1280+ 0+2560 
= 3840 
Lsk<4 * 
pa myg = mfl, 1] + m[2, 4] + PoP:P, 
= 0 + 3360 + (4 x 16 x 20) 
= 3360 + 1280. 
- =4640 evacuees 
= =m{I, 2) + m3, of 2t4 
aia Ever eure 10 x 20) 
= 640 + 160 + 800 
= 1600 
= m{1, 3] + m[4, 4] + PoP3P, 
=960+0+(4 x 8 x 20) 
= 960 +0+ 640 
= 1600 
Now, initially i= 1,j=4 


step 5: In that stage we have a option that ec have 


k=2 M)3 





Step 6 : As we have seen in the above tree, the edge b is not 
connected to that tree so we connect abas if we reached 
the edge b, a to b have minimum cost so the resultant MST is 





os 
Hence minimum cost is= 13+ 1+3+4+2=2 


of multiplication |” 
1 6, 1 0, 8, 2 0 
volved. 

[R.T.U. 2015] 


A 


Q24 Find the optimal parenthesizalion 
Of a matrix chain specified by (4, 


k=3 my 
* Show all tables and decision steps '" a 


rar ay aca lues of auxilary table M and S, we 


Let Po = Since we have all the values o! 
=i o 4 have final optimal parenthesiation. 
P= 10 Nowif i=jthenmfijJ=0 
P5=8 SO M1 = Mgq = M33 M44” 

P,=20 


~ Auxiliary table m and s need to be constructed 











So _pritf “PRINT_OPTIMAL. PARENS (S, 1, S(1,4)) 
PRINT_OPTIMAL_PARENS (S, S(1, 4)+1)Printf” 
So, 

> ((S,1,2)(S, 3, 4)) 

=> ((S, 1, 1)(S, 2, 2)) (S, 3, 3) (S, 4, 4)) . 

((A\, A)) (A;, A,)) 


OO OE 

Q.25 When and how dynamic programming approach is 
applicable? Discuss matrix chain multiplication 
with reference to dynamic programming technique 
and also write a subroutine for matrix chain 


multiplication and apply it on the following array, 


[R.T.U, 2013) 


Ans, Dynamic Programming typically applies to optimization 
roblems in which we make a set of choice in order to arrive 
t an optimal solution. 


Dynamic programming \is effective when a given 
ubproblem may arise from more than one partial set of 
hoices; 
¢ The key technique is to porate solution to each such 

subproblem in case it shoul: reappear. 

» Dynamic programming, like the divide and conquer 
method, solves problems by combining the solutions to 
subproblems. 










Le 


\ 


» a 
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> 

|e Dynamic programming applies when the subs =) 

Subpropy Shy 
lv 


overlap- that is, when subproblems share 
e A dynamic-programming algorithm so 
subproblem just once and then saves its a 
table, thereby avoiding the work of reco 
answer every time it solves each subpro 
When developing a dynamic-programm; 
we follow a sequence of four steps. - 
Steps to develop a dynamic programmin 
Refer to Q.3. | 
Steps to develop a dynamic programmin 
1. Characterize the structure of an optim 
2. Recursively define the value of an optima] Solutig . 
3. Compute the value ofan optimal solution, typical} F 
bottom-up manner. Ying 
4, Construct an optimal solution fro 
information. 
We can define matrix chain multiplication as follows 
Given a chain (A, A>,...A,) of n matrices, where fy 
i =1, 2,..., n, matrix A; has dimension Pi-1 Xpj, fully 
parenthesize the product A, A>...A,, in a way that minimizes 
the number of scalar multiplications. . 
Note : In matrix chain multiplication problem, weare 
not actually multiplying matrices. Our goal is only to determine 
an order for multiplying matrices that has the lower cost, 

' For example : If the chain of matrices is <A,, A,,Ay 
A,>, then we can fully parenthesize the product Aj, A;, Ay; 
A, in five distinct ways: 

(A,(A2(A3A,))) 
(Ai((Ap A3)Aq)) 
((A,A3)( A3A4)) 
(AAD ADAD 
To illustrate the fae cost incurred by differet! 
parenthesization of a matrix product, tg 
Consider the problem of a chain <A), Ap, As? of tet 
matrices, 
Suppose dimentions of the matrices are 
10100. forA, | 
100x5 , for A, 


€ 
DsWe, : ch 


T In 
MPUting 4° 
blem "B thy 


ng gor 


8 algorithn, 


M Computed 


5x50 for A; 
Now | 
((A,A,)A3) 


10.100.5 = 5000 (AA) 
10.5.50=2500 ((A,A2)A3) 5 
5000+ 2500=7500 Scaler multiplications 
(A,(A,A;) oe 
100.5.50=2500 (A,A3) 


10.100.50 = 50000 (A,(AzA3) ns 
2500 + 50000 = 75000 Scaler multiplicati® 


My; 





8 algorith, 


al solution 


aI DUN YP wpYP 





ys 


hea gramming method to determine how to optimally 





of Algorithms : 
(GE. = Computing the product according to 


sation is 10 times faster. 
nti the number of parenthesizations - 
Oe. 


the first 


1 if n=] 


a 3 
pO) = 1S" p(k) p(n-k) if n>? 
k=l . 


dynamic programming : We shall 


thesize a matrix chain using four steps : 
oi Steps to develop a dynamic programming algorithm 
fof 


subroutine fo 


r matrix chain multiplication 


= Algo-matrix-chain order (p) 


l. 
2, 
3, 
4, 


5 


6, ». 


n« length [p] —1 
Let m [1..n, 1..n] be new tables 
For i¢-1 ton a 

129 . 
Ay 2 to n=/ is the chain length 
(i) do fori<- 1 ton—/+1 
(ii)Setj=i+/—-1 
Gi) mfi,j]=% 
for k<-i to j—1 
(i) Setqe-m [i, k]+m[k+1, j]+p. P,P, 
(i) ifq<mfi,j] 
(ii) m[i, j] <— q then 
(iv) s[i, j] <-k 
(v) return m and s 


Algo-print-parenthesize (s, i, j) 





AS] 








ifi=j 


. print “A,” 
else 


print “( ” . 
Print_optimal_parenthesis (s, i, s [i,j] 


use the 


Print_optimal_parenthesis (s, s[i,j1)) . 


Print a ; : 
Now we have to apply it on given array, 


Po= 30, p, =, p,=40, p3= 10, pa=2> 7 
The length of matrix chain is length tl i ; 
So, n=length [p]-1=4, and matrices are “1 
* 40, A3=40 x 10, Ag= 10 * 25 

Our matrix is 





=30 x 1, 


(AA.35 ) 


Step 1; Auxiliary table m and s need to be constructed 





Fig. . 
We are considering the table only for above the main 
diagonal for [i <j], so only that part of table m and s need to 


‘be constructed following the algorithm matrix chain order: 


If i=j,mfi,j]=0 
So, Mj}, M22, M33, My4=0 
Step 2 : In all other cases in table we can see i<j. (For example 
M4, Where i=1 and j=2). ; 
So, initially m[i, j]= © for i<j _ 
Now, we have to calculate minimum value of m[i, j] © 
and put those value in table m. _* 


m,= min {m[i,k] + m[k +1, j]+ Pi1PLP } 
I<k<j . 


Here 1<k<2 , 

~ So, the only value of k=1 that satisfies }<k <2 
So, m= ml, 1] +m[2, 2]+ Po Pi P2 7 
=> 0+0+30x1x40 

= 1200 . 

So, m[1, 2]=1200 and s[1, 2]=-k=1 ‘ 
Similarly, m,,=m[2, 2]+m[3, 3}+ p;P2P3 
=> 040+0x40x10 


= 400 ; 
Where the only value of k=2 which satisfies 2<k <3 
So, m{[2,3]=400 


And s[2, 3J=k=2 
And m3,= m[3, 3}+m[4, 4}+ p2P3P, 
0+0+40~x 10x 25 


=> - 

= 10000 
Where, the value of k=3 
So, m[3,4]=10000 


And_ s[3, 4]=k=3 a 
Step 3 : For ie value of m,3we have to select minimum of 2 


values for i<k<j or 1<k<3- Actually there are two ; 

values of k which satisfies 1<k <3; k=1 and k=2. 

so, -m{l,3}= gin im k]+ mik +J)+ PPPs 
2° . I<k< 


Fork=1 
m[l, 3) 7m 








m[2, 3 
= 30 x 


For k 


a 


= 1200+0+30%40*10 
= 1200+12000 
= 13200 


If we compare 13200 and 700, we can easily see that 
m{1, 3] is minimum for k=} 
So, . m[1,3}=700 


s[1, 3]=k=1 — 
Similarly, m[2, 4] = nin {m[i,k] + m[k + 1, j]+ Pi-1PkPj} 
For k= 2, , 
_ m2, 4] = m2, 2]}+m[3, 4]+p;P2P4 
= 0+10000+1 40x25 
= 10000+1000 
= 11000 
Fork =3, 
m[2, 4] = m[2, 3]+m[4, 4]+ p;p3Pq4 © 
= 400+0+1x10x25 
= 650 
[2, 4] is minimum for k=3 
So, m[2,4]=650 
s[2, 4]=k=3 


Step 4 : Next we have the values of m,, and there are three | 


possible values for k which satisfies 1 <k <4; k=1, 2 and 3 
m,,= min {m[i,k]+ m[k +1, j] + Pi-aPKPj} 
For k=1, Jo fe . 
m{1,4]=m[]1, 1]+m[2, 4]+popip, 
=0 +650 + 30 x 1 x 25 
= 1400 ie 
For k= 2, 
m{1,4)=m[1,2]+m[3,4]+pop.p, 
= 1200+10000+30x40x25 = 41200 


Fork=3, © 

an{1, 4] =m[1, 3]+m[4, 4]+ pop;p 

= 70040+30%10x25 * ~ 
= 8200 


m[1, 4] is minimum for k=1 
so, m{1, 4] = 1400 
a s[1,4]=k=1 
tep 5 : Since we have all the value of auxili 
ta 
s, we have find optimal parenthesization. a ie 





Fig. 
Step 6 : Using “PRINT_OPTIMAL PARE 
° —_ ie NS” ‘ 
as input, the tabels. We have to find optimal ea method and 


Initially value of i=1 and j=4 nthesization, 





B.Tech. (V Sem.) C.s, Sol 
So, Print “(“ ; = 
PRINT_OPTIMAL_PARENS (s, | iy 
- PRINT_OPTIMAL_PARENS (g ae 4) 
PRINT)” eS sll a 
So, we have parenthesization (by puttin 
s-table in above given formula). 
=> (51,0624) 
=> (AMS, 2, 3)(s, 4, 4)) 
= ((A,\(S, 2, 2)(s, 3, 3)(S, 4, 4)) 


= [(AnArA3 Aw) 


ee tig Lae GP dai bng can eects Ge 
Q.26 Define how Knapsack problem is solved 5), 
dynamic programming approach? pe af Using 

OR °U, 201 


_ What is dynamic programming ? What is prinej 
- of optimality ? Explain knapsack problem fia 
: . f 
dynamic programming. [Raj. Univ. 244 
Ans. Dynamic Programming : Refer to 0.2]. 

Principle of ‘Optimality : The principle of optimality 
states that for solving the problem optimally its subproblen 
should be solved optimally. Not all the times each subproblen 
‘is solved optimally. : 

One way to solve problems for which it is not possibleto 
make a sequence of stepwise decisions leading to an optimal 
decision sequence is to try all possible decision sequences. 
We could enumerate all decision sequences and then pick ot 
the best. But the time and-space requirements may be 
prohibitive. Dynamic programming often drastically reduc 
the amount of enumeration by avoiding the enumeration of 
some decision sequences, that cannot possibly be optimal. 
dynamic programming an optimal sequence of decisions § 
obtained by making explicit appeal to the principle of optimal 

Knapsack Problem : Given a list of items, we ha? 
pack the Knapsack (bag) in such a manner so as t0 get 
maximum (optimum) total value. Each item of the lis ie 
associated weight and value. It should be noted that “eh 
ae that we can carry is not more than the fixed We e 
: So in order to pack the Knapsack we have to consioe! ie 
bis of item as well as its value. We assume that @ 

Sand values are positive integers. 
w= <w), Wo, W3 
; V=<V1, Vo; V3 eats V7" 
: he Knapsack problem has two variants : , 
j 0/1 Knapsack Problem . 
nthis problem the list of items are indivisible: 


ei ; 
ither We take the item or discard it. We will discuss 


Problem using DP approach, 


eat 
that this 


jotal v4 


‘the - 









: of Algorithms 
gE ctional Knapsack Problem 


is, the list of items are divisible; that means we can 


yest faction of an item. We describe this problem using 
roach. 
eed app 


* oft 


Knapsack Problem | 
ghe 0/1 Knapsack problem is stated as follows : Given - 
afin items and a Knapsack having capacity w, such that 
t item has some weight w; and value v; then the problem 
a «the Knapsack in such a manner so that a maximum 

yalue is achieved. | 
roblem is said to be 0/1 Knapsack problem because 


_. Thep gee ‘ 
be item from the list is either rejected or accepted. 

#item W, V, 

bse, 3 

. 2 6 6 

a. TD 
Knapsack W=30 4 8 9 

| 5 12 


Fig. : Knapsack with w = 30 


Simple Approach 
It can be seen that there can be 2" possible combination 


ofitems as there are ‘n’ items in a set. One method is to find 
allthe possible combinations and select the best one in sucha 
manner which will provide maximum value and weight less 
than or equal to Knapsack capacity, w. Well, it can be observed 
that for this the running time complexity will be 02"): 


Dynamic Programming Approach. 
Again according to DP approach we have to break the 


problem into several (simple) smaller subproblems. For this 
consider that the items in the given set ‘S’ are labelled from 1 
then a subproblem would be to obtain an optimal solution 
or ms 


| Ss. = <item labelled 1, 2, 3, «++» k> st 
The question arises whether we can obtain th 
Soltuion (S_) in terms of the subproblem (S;), as described 
ve or not. The answer is ‘no’, this is illustrated below : 
Maximum weight for Knapsack : w= 30 
For S,: 
Total weight 225 <wy), Wo W3» Wy? 
Maximum value : 23 <V}, V2» V3» V4? 
For Ss: 
Total Weight : 30 <w;, W2, W3> Wa? 
Maximum value : 32 <v2, V3, V4 Vs> cade 
It can be observed that solution for S4 "6 not the ne 
ay Clution for S;. So, we include an additional parame™!, 


ite Which will signify the exact weight for each apeunne 
Ms, For this subproblem we have to co P 


e final 





: | (AA.37) 
plk, w]. From the above explaination we can formulate the 
subproblems as recursive rule : 


Ky k-1 
_ Sele] ifwyrwy 
Kolk, w] = bce eae otherwise 


From the above recursive formula we can ‘depict that the 
best subset of S,, that has the total weight @, may either contain 
item K or not. Following two cases arise in this manner : 

Case I: When w, > W ; 

_In this case item ‘k’ cannot become the part of the 
solution, as the weight is greater than ‘W’ which is 
unacceptable. 

Case II : When w, < W 4 

In this case the item k can become the part of the solution, 
and the item ‘k’ is chosen such that it has the maximum value. 
The algorithm for the 0/1 Knapsack problem is given 
below: 
Algorithm 0/1 Knapsack ‘ 
_. The above algorithm solves the 0/1 Knapsack problem. Given 
a Knapsack of weight capacity “W’, and a set of items with 
weight ‘w,’ and value ‘v,’. This algorithm determines the packing 
of the Knapsack in such a manner that a maximum value is 
achieved and the respective weight is less than or equal to W. - 
Step 1: Loop, initialization 
for w < 0 to W = till the total capacity 
set K,[0, w]< 0 
Step 2 : Loop 
 forw< 0ton=> set of items” 
set Ki, 0) < 0 = 
Step 3 : Loop, checking ‘K? whether part of solution 
or not —— 
fori<-lton 
forw<-O0toW | 
if (w,<=w) then > item ‘? can be the part of solutior 
if (v, + K, [i— 1, w- Wil > Kpli- 1, w)) then 
set Kfi, w] <vjit K li -1,w- wi] 
else | . 
~ set K,[i, w] < K,fi-1, w] | 
- else set K,[i, w] <— Kpli-!, w] > W7 
Step 4: Finished 
Exit. ; 
Example : Consider a Knapsack having weight capaci 
w =3 and number of items are three such that, 


: §=3 
wW, = <I, 2; 3> 
v; = <2, 3, 4> 


AA.36 
= 1200+0+30x40x10 
= 1200+12000 
= 13200 
If we compare 13200 and 700, we can easily see that 
n[1, 3] is minimum for k=1 
So, . m[1,3]=700 


s[1, 3J=k=1 - J 
3imilarly, m[2, 4] = min {mli, k] + m{k +1, j] + PiPKP)} 
For k=2, . 
— m2, 4] = m2, 2}+m[3, 4]+p P2P4 
=0+10000+1*40*25 
= 10000+1000 
= 11000 
For k= 3, 
m[2, 4] = m[2, 3]+m[4, 4]+ piP3P4 
= 400+0+1*10*25 
= 650 
[2, 4] is minimum for k=3 
So, m{[2,4]=650 
s[2, 4]=k=3 


step 4 : Next we have the values of m,, and there are three | 


ossible values for k which satisfies 1 <k <4; k=1, 2 and 3 
m,4= min {m[i,k]+ m(k + 1, j] + Pj-1PxP}} 
For k=1, 24 | 
m1, 4]=m{[1, 1}+m[2, 4]+pop iP, 
=0+ 650+ 30 x 1 x 25 
= 1400 
For k= 2, 
m{1,4)=m[1,2}+m[3,4]+pop2P, 
= 1200+10000+3040x25 = 41200 
Fork=3, © . 
-m[l, 4] = m{1 ’ 3}+nf[4, 4}+ PoP3P4 
= 700+0+30x10x25 - 
= 8200 
m[1, 4] is minimum for k=1 
so, m[1, 4]= 1400 
s{1,4]=k=1 
Step 5 : Since we have all the value of auxiliary table 
es 
s, we have find optimal parenthesization. as — 





Fig. 


tep 6 : Using “PRINT_OPTIMAL_PARENS” method and . 


; input, the tabels. We have to find optimal parenthesizati 
‘ejtally valueof Sand jus" 


cither we take the item or discard it. We will dis 
problem using DP ap ; : ae 


v 


| B.Tech. (V Sem.) C.g | 
bhai Solveg 


2 cosee 


50, ee 
PRINT_OPTIMAL_PARENS (s, |, g 
PRINT_OPTIMAL_PARENS (s, gf; Ll, 4y 
PRINT “)” | Alt g 
So, we have parenthesization (by puttin 
s-table in above given formula). 
o> LD624 
= ((A,)(S, 2, 3)(S, 4 4)) 
= ((A,\(S, 2; 2)(S, 3, 3)(S, 4, 4)) 


= [(An@rAdAd), 


Se Te oe he gs 
Q.26 Define how Knapsack problem is solved 


by Using 


dynamic programming approach? 
ly prog id H [R-Tv, mn 


What is dynamic programming ? What is principi 

- of optimality ? Explain knapsack problem ee 
dynamic programming. [Raj. Uniy om 
—————————————— eee 


Ans. Dynamic Programming : Refer to Q.21. 

Principle of Optimality : The principle of optimality 
states that for solving the problem optimally its subproblen 
should be solved optimally. Not all the times each subproblen 
is solved optimally. : 


One way to solve problems for which it is not possibleto 
make a sequence of stepwise decisions leading to an optimal 
decision sequence is to try all possible decision sequences 
We could enumerate all decision sequences and then picko 
the best. But the time and.space requirements may be 


| prohibitive. Dynamic programming often drastically reduss 


the amount of enumeration by avoiding the enumeration ¢ 
some decision sequences, that cannot possibly be optimal. 
dynamic programming an optimal sequence of decisions § 
obtained by making explicit appeal to the principle of optimal 
Knapsack Problem : Given a list of items, W° have 
pack the Knapsack (bag) in such a manner.so aS to get 
maximum (optimum) total value. Each item of the list bss 
associated weight and value, It should be noted thet 
weight that we can carry is not more than the fixed Wr 
W. So in order to pack the Knapsack we have to conside ie 


Weight of item as well as its value. We assume 
Weights and values are positive integers. 


W = SW), Wo, W3 «0 Wrz 
VV, Vo, V9 scare V.>. 
The Knapsack problem has two variants : 7 
¢ 0/1 Knapsack Problem 


In this Problem the list of items are indivisible; tht f 


proach. 


a 


Bthe valu 





Pa | SE -qonal Knapsack Problem 
6 


., the list of items are divisible; that means we can 
? 


by action of an item. We describe this problem using 
ihe 


h. 
oe ; Knapsack Problem 


if items and a Knapsack having capacity w, such that 
git vem has some weight w; and value v; then the problem 
ah aa ihe Knapsack in such a manner so that a maximum 
0 value is achieved. 


~The problem is said to be 0/1 Knapsack problem because 


geitem from the list is either rejected or accepted. 


#item W, V, 
1 4 3 
2 6 6 
é - any 3 2g 3 
apsack = 4 8 9 
cme 5 10 12 

5 Fig. : Knapsack with w =30 

Simple Approach 


Itcan be seen that there can be 2” possible combination 
ofitems as there are ‘n’ items in a set. One method is to find 
illthe possible combinations and select the best one in sucha 
manner which will provide maximum value and weight less 
than or equal to Knapsack capacity, w. Well, it can be observed 
that for this the running time complexity will be O(2"). 

Dynamic Programming Approach. 

Again according to DP approach we have to break the 
problem into several (simple) smaller subproblems. For this 
consider that the items in the given set ‘S’ are labs led from 1 


Be then a subproblem would be to. 
or 





*S. = <item label 

The question aris 

‘oltuion (S_) in term 

Ve Or not. The 
Maxis 

For S, 

Total 


fi 










in obtain 
S,). as descrit 
ated below : 









ape o/1 Knapsack problem is stated as follows : Gives ‘ 
















(AA.37) 


Kok, w]. From the above explaination we can formulate the 
subproblems as recursive rule : 





Kp| k-1,w 


ol if Wy) 
Kk, w) ™ max(K p[ k-1, WK p[ k-1,w-¥y [Vy 


otherwise 


From the above recursive formula we can depict that the 
best subset of S, that has the total weight o, may either contain 
item K or not. Following two cases arise in this manner : 

Case I: When w,, > W ; 

In this case item ‘k’ cannot become the part of we 
solution, as the weight is greater than ‘W’ which * 
unacceptable. . 

Case II : When w, < W : 

In this case the item k can become the part of the ae 
and the item ‘k’ is chosen such that it has the maximu a 

The algorithm for the 0/1 Knapsack problem 
below: 

Algorithm 0/1 Knapsack ‘ 

The above algorithm solves the 0/1 Knapsack 4 
a Knapsack of weight capacity “W’; and " oni nest 
weight ‘w; and value ‘v;’. This algorithm sagen vail 
of the Knapsack in such a manner that @ nant 0 \ 
achieved and the respective weight is less t 

: Loop, initialization anelly 
cs . w E0 to W = till the total ous 
set K,[0, w|< 0 
Step 2 : Loop _ 
 forw< 0 ton= set of ite? 
set Kl 01< 9 
Step 3 : Loop, © 


yeu 








* 
mo nds 








gorith m does 















jack problem is a 
derives its name from 
2 possible essentials that 
weight) to be carried ona 
with a cost and a value, then. 
) item to include in a collection 
than some given cost and the total 
ale. . 

s of knapsack problems are : 





slem- 

ng, V e have n kinds of items, x; through 
as a value p, and a weight Wy The maximun 
can carry in the bag is C. Tae 
psack problem : The 0-1 knapsack problen 
number of each kind of item to zero or one. 
smatically the Q-1knapsack problem can b 
jas: . 








(AA38) 
Ans. On applying algorithm 0/1 Knapsack, we have 
# item Wj vy; Max weight =3 





fori<l1ton 
set K, [i, 0] < 0 
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; B 


Yy=3 
Wy=2 
ws] 


w-wj"-) 


wd 
w23 


w-w7 


ape 
































is : ted above onl 
“jgorithm presen only compute 
Cr possible value that can be taken in the ie 
4 mjue in K,[n, w]. To choose the items that take part 
i ‘his aximum value we have to perform some more 


as for obtaining actual Knapsack items. 
» The table has all the information that we require. 


‘The maximum value that we can place in the Knapsack 
gen bY K,[n, w)- 


“consider j=nandk=w, then following condition arises. 
whether K Li, k] is equal to Ki _ Ll, k] or not. If the 
softion is true then we have to mark the i” item as in the 
sack. The detailed algorithm for finding the actual 
csapsack items is given below. 

Algorithm FindKnapsack 

The above algorithm finds the actual Knapsack item. ‘K,’ 
ores the final solution as the maximum value and the weig 
“ofthe item which is less than or equal to w. oo 
Step 1 : Initialization , 

set i <n. 

set k < w. 


Knapsack 

while (i> 0 and k> 0) 

" if K, [i, k] #K, [i—1, k]) then 

mark the i item as in the Knapsack 

seti<-i-1 

setk <k-—w; 

else 

 seti<-i-1l 

Step 3: Finished 

Exit. . c 

_ For finding the actual Knapsack items we are running 

ndknapsack Algorithm on the previous example: — 
i=3 
k=3 
y= 4 

w=3 


_. Ki k= 
Kfi- 1, K=5 


sn? 
k=3 
yy23 
wy=2 


_ Kgl 41= 5 
Kofi 1, ¥1= 2 





Step 2: Loop, checking ‘K? as a part of the 





k-w=1> 
k=k-w; 
i=1 
k=1 
Vj=z2 
w= i 
Kp, k]=2 
K,fi-1, k]=0 
k-w,=0 
k=k-w 
i=0 
k=0 





The optimal Knapsack contains; 
S = {1, 2} 
w,= {1,2} =} <W 

_ 6 = {2,3} = {5}. Optimum value. 








| Q.27 What is the Greedy approach? Does it always give 


optimal solution? Give two examples in which - 
Greedy algorithm gives optimal solution. 

[R.T.U. 2010, Raj. Univ. 1997] 
ae aS ee ee 
ee 
Ans. Greedy algorithms make good local choices in the hope 
that they result in an optimal solution: : 

e They result in feasible solutions. 
e Notnecessarily an optimal solution. 
e A proof is needed to show that the algorithm finds 
an optimal solution. 
_ -Acounter example shows that the greedy algorithm does 
not provide an optimal solution. 
-Knapsack Problem : The knapsack problem is a 
problem in combinatorial optimization. It derives its name from 
the maximization problem of choosing possible essentials that 
can fit into one bag (of maximum weight) to be carried on a 
trip. Given‘a set of items, each with a cost and a value, then. 
determine the number of each item to include in a collection 


| so that the total cost is less than some given cost and the total 


value is as large as possible. 
- The different kinds of knapsack problems are : 


Consider the problem 

In the following, we have n kinds of items, x, through 
x, Each item x; has a value p; and a weight w, The maximum 
weight that we can carry in the bag is C. 

0-1 knapsack problem : The 0-1 knapsack problem 
restricts the number of each kind of item to zero or one. 

Mathematically the 0-1knapsack problem can be 


formulated as : 





Fractional knapsack problem 


n 
Maximize > ViX; 
i=l 


n 
subjectto >, Wixi; W 
i=l 


Where W, and x; can take any value between 0 and 1. 

Although the problems are similar but the Greedy 
approach does not guarantee to give the optimal solution in _ 
case of 0-1 knapsack problem ,it can be a sub-optimal solution. 

The greedy approach guarantees to give an optimal 
solution to the fractional knapsack problem which we will be 
seeing. . 

There are three approaches to the fractional knapsack 
problem by using greedy strategies : 

(i) Greedy by Profit : At each step select from the 
remaining items the one with the highest profit (provided the 
capacity of the knapsack is not exceeded). This approach 
tries to maximize the profit by choosing the most profitable 
items first. . 

(ii) Greedy by Weight : At each step select from the 
remaining items the one with the least weight (provided the 
capacity of the knapsack is not exceeded). This approach 
tries to maximize the profit by puttin gas many items into the 
knapsack as possible. 

(ili) Greedy by Profit Density : At each step select 
from the remaining items the one with the largest profit density, 
(provided the capacity of the knapsack is not exceeded). This 
approach tries to maximize the profit by choosing items with 
the largest profit per unit of weight. | -_ 

The first two approaches also does not necessarily gives 
an optimal solution to the problem. But the 3 approach gives 
the optimal solution. 

We apply the greedy method to solve the knapsack 
problem. We are given n objects anda knapsack or bag. Object 
i has a weight w; and the knapsack has a Capacitym, . __ 

Ifa fraction x;, 0 < x; <1, of object i is placed into the 
knapsack, then a profit of Pix; is earned. The objective is to 
obtaina filling of the knapsack that maximizes the total profit 
earned. Since the knapsack capacity is m, we require the 


total weight of all chosen objects to be at 
most m. Fo 
the problem can be stated as _— 


maximize 2 PjX; 
Isisn 


Ly 
subject to 2 w;X; Sm a 
and0<x,<ll<i<n. ™ 
a ee “. 3) 
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The profits and weights are positive numbe 

A feasible solution (or filling) is any se Ts, 
satisfying (2) and (3) above. An optimal Solution Xi, . 
solution for which (1) is maximized. Isa fag 

Example : Consider the following inst, 5 
knapsack problem : Nee of 


th 
n=3,m=20, (Pj, Po, P3) = (25, 24, 15), and (y, | 


=(18, 15, 10). Four feasible solutions are : 1b Wy,y ; 
(X1) Xp X3) ,. =UWix, , 

1. (1/2, 1/3, 1/4) 16.5 X 

. 2:1, 2/15, 0) 20 2495 

3. (0, 2/3, 1). 20 2 


4.(0,1,1/2) 20 4 
. Of these four feasible solutions, Solution 4 y; 31 
maximum profit. Yields 
When one applies the greedy method to the solut; 
the knapsack problem; there are at least three diet 
measures one can attempt to optimize when determinin wit 
object to include next. These measures are total Profit, capaci 
used, and the ratio of accumulated profit to Capacity used 
Once an optimization measure has been chosen 
1 Algorithm GreedyKnapsack (m, n) 
2 //p{1:n]and w[1 :n] contain the profits and weigh 
respectively | 
3 // of the n objects ordered such that P [i] /w{i] 2p 
[i+ 1]/w[i+1]. 
4. //mis the knapsack size and x [1 :n] is the solution 


vector. 
ce. hs | _ 4 
6 for i=1 ton do x{i] : =0.0; // Initialize x. 
7: U=m;" 
8 fori =1tondo 
9 . 
10 if (w [i] > U) then break; 
Il x[i]= 1.0; U=U-—w [i]; 
zy) % 
‘13 


(i < n) then xi] = U/w [i]; 


Algorithm : Algorithm for greedy strategies i 
knapsack problem method suggests choosing objects ‘ 
inclusion into the solution in such a way that each cl 
optimizes the measure at that time. Thus, a greedy ™. 
using profit as its measure will at each step choose 4" ? i 
that increases the profit the most. If the capacity sg 
used, the next object included will increase this O° 
‘though greedy-based algorithms using the first tWO™ ig 
do not guarantee optimal solutions for the knapsack P , 
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CuapTer In A NUTSHELL 


q KMP Matcher 3 
The working of KMP algorithm is similar to the finite 
ytomation matches; in this, pattern string P, and text string T 


a toth are scanned from left to right, and are compared. If any 


nismatch occurs then the algorithm searches the largest suffix 
of the “wrong start” which is also a prefix of a pattern P. 
Thus, it determines the shifting of the pattern P for possible 
match. . 
_ The KMP algorithm has a linear running time of O(n+ m), 
which is achieved by using the auxiliary function P,(prefix 
function), pre-processed from the pattern P in time O(m). 
The function P computes the shifting of pattern matches 
within itself. 


If for a given pattern P, a mismatch is detected at some 


Position j then we know that we have already matched j — | 

tharacters successfully. By this idea, we can decide the 

Possible shifts, so that we can restart our matching. 
Consider the string “10100” which is mismatched at 5th 


tharacter, then we already know that the text so far matched 


“Onsists of “1010X”, where X is not known. Thus, we can 
"start matching at the 3rd character which is ‘1’ against the 


‘tknown character *X’. Given a pattern string P, each string 
Pesition j can be pre-processed. Thus, a position can be 


tained from where to restart the matching when a mismatch 
rs immediately after j" position. It can be accomplished 
® following manner. . 
*From the original string consider a substring 0... 
mt Starting at the end of the substring, “slide” it along the 
“ginal String, | | 
it 3 We havea potential restart position for a mis 
sition, where all overlapping character matches. 


match after 


4 


‘ text. 


¢ Take an auxiliary array - “next”, and store that largest 
potential restart position forj. ' . 

QO) Boyer Moore Algorithms : The Boyer-Moore- 
algorithm can give substantially faster searches for the long © 
strings. 

The basic idea behind the algorithm is that the pattern is 
scanned from left-to-right when proceeding through the text, 
which is also referred to as “looking glass heuristic”. 

The strategy for BM algorithm is : 

e For finding the right most mismatch, it starts searching 
at the right of the pattern. 

e It uses information about the possible alphabet of the 
text; as well as the characters in the-pattern. . 

For determining the smallest possible shifts, BM works 
with two different preprocessing strategies each time when a 
mismatch occurs the algorithm. — 

O Bad Character Heuristic : As the name suggests it . 
concentrates on the “bad character” in the -text where the 
mismatch has occurred. If that character is not contained in 
P, then the pattern is shifted after “bad character” in the string 
for further matching. But if the “bad character” is somewhere 
in the pattern then we search for the right most appearance 
of the “bad character” in the pattern and match it against the 


O Good Suffix Heuristic : As the name symbolises, it 
works for the suffix, suppose for a given pattern P if we have 
already.matched some suffix S, but there isa mismatch “on 
the preceding character of x then, we shift the pattern to ae 
along the string so'that the matched port is occupied by the 


same suffix ‘S’. It is to be noted that no complete match of 


the suffix ‘S’ is possible if *S’ does not occur elsewhere in P. 
In this case, we have to match the largest prefix of P. 









Q Travelling Salespersons Problem ee 
In this problem, salesperson needs to visit ‘n cities in 
such a manner that all the cities much be visited only once 


and in the end he returns to the city from where he started, 


with minimum cost. 

Given a group of cities C = (Cj, C2, C3, .... Cy), where 
-cost i, j denotes the cost of travelling from city C; to city Cj. 
The travelling salesperson problem is to find a route starting 
and ending at C, that will take in all the cities with the mmimum 
cost. According to the greedy strategy : 

e Start with any arbitrary city, say Cy. 

e Choose the minimum cost city from C. 

e At any step i we will be left with n—i cities. 


* ~ 


Previous YEARS QUESTIONS 





Q.1 What is Travelling salespersons problem. 





Ans. In this problem, salesperson needs to visit ‘n’ cities in 
such a manner that all the cities much be visited only once 
and in the end he returns to the city from where he started, 
with minimum cost. ~ 


Q.2° Explain the working of KMP matcher. 


Ans. The working of KMP algorithm is similar to the finite 


automation matches; in this, pattern string P, and text strin eT] 


both are scanned from left to right, and are compared, If any 
mismatch occurs then the algorithm searches the largest suffix 
of the “wrong start” which is also a prefix of a pattern P. 


Thus, it determines the shifting of the pattern P for possible 
match. . 


° ° Z 3 
Q3 What is the basic idea behind of Boyer Moore 
Algorithm. 


Ans. Thebasic 1) LE 
Ans. The basic idea behind the algorithm is that the pattern is 


scanned from left-to-right when proceeding through the text, 
which is also referred to as “looking glass heuristic”. 


2.4 Write the strategy for Boyer Moore Algorithm. 
ins. 


e — For finding the right most mism i i 
atch, it starts s FP 
at the right of the pattern. , = 


¢ — It uses information about the possible alphabet of the 
text; as well as the characters in the pattern, 











of Algorithms 
pose 9} thus, each character is a q 









¢ The method is repeated until all the 





















. tie x . vs IS a decimal dio; 
andat every step We have to select the city wie, the get Baa with the calculation of decimal value for 
weight. Mii pores? d the sub string of given text. : 


.) 
oh pate ror the given pattern P[1...m], p denotes the decimal 































pis calculated using Horner’s rule as: 
_ p=P[m] + 10(P[m — 1] + 10 P[m—2]+... 102] 
$10 P [1]).---)) = 
Similarly, t,, , is computed using tas. 4. 
te, = 10(,- 10™'T [S+ 1) +T[S+#m+]] 
t,,, calculation shifts the pattern by one digit. 
Subtracting the term 10™'T [S + 1] removes the higher 
order digit from t, and multiplying it by 10, shifts it one position 
towards left. Adding the term T [S + m + 1] brings lower 
‘order digit to the number. 
Pattern P = <3, 1, 4, 1, 5> 
So, m= length [P] = 5 
We have to check if T [S+ 1 
Where, 0<S<n-—m 








Q.5 What do you mean by bad character heuristic 






Ans. As the name suggests it Concentrates on the 
character” in the text where the mismatch has Occurred f 
that character is not contained in P, then the pattern is shifts 
after “bad character” in the string for further matching, By 
if the “bad character” is somewhere in the pattern then w 
search for the right most appearance of the “bad characty’ 
in the pattern and match it against the text. 






















p =P and q=31415 mod 13 =7 
For, S=0,t,,,=? 
There is no shift initially so, _ 

t,= 23590 mod 13 

=8+#7 
So, pattern unmatched and shift is applied. 








Q.6 Using Rabin Karp algorithm to solve the fet 
T = 2359023141526739921 and P = 31415 
modulo q = 13, m= 5. [R.T.U. 2013, 2ll 

| i 548 
Given the text T = {2, 3, 5, 9, 0, 2,3, L445" 

7,3, 9, 9, 2, I} and P = {3, 1, 4, 1, 5 ad 

q = 13, m= 5, Choose the pattern match 
average case complexity and explain the ce 

Process. Justify the answer for choose ; 

algorithm. [REE 












= 
=a 2222 










OR ~ 
Explain Rabin Karp method 
Also give the algorithm for the same. F prb.all 





i 
with suitable exam 


IS. 








=t= (10(23590 —2 x 1000 
nee ft i lied. 
So, Pattern unmatched and shift 1s apP 


80, for S=1 t 
> 9 S41 


( 

“ne sith 
Ans. The Rabin Karp algorithm involves ae ~ ue 
, Pattern matching, ie., preprocessing and match ae cont 
explanation, we assume that string chara 














the given test T[1...n], t denotes the dec: 
and for ‘ € decimal 
ae aa length m substring T [S +]... S +m] where, 
va _—m. . 
< n . . . . 
935 For the given pattern, S is valid shift if and only if 
zt which means, 
pos P[l....m]=T[S+1...$+m] 
at ee a Graph G solution is commuted time 8 (m) and t, values are comput di 
links be brave; Ise vi ne 
cages refer _ as epeliriged Problem acing _ 69 (n—-mt 1). So we compare p with each value of t, and- 
set of the lake are showing the path vatermine valid shift s in time [0 (m)+@ (n—-m+1)]=6 (n). 








dT 
TIS+ 1] is higher-order digit for older T[S + 1] an 
*m+ 1] is the new lower-order digit. 
-h= 10000 for this example. 


0)+2) mod 13 






P GY yy iY: 0 
ForS =2,t,,,=t,=(10(35902—3 x 10000) + 3) mod 13 
= 59023 mod 13 
=2F47 
Pattern unmatched and shift is applied. 
Step 4 





=1147 
Pattern unmatched and shift is applied. 
Step 5 





For S =4, t,, ,=t, =(10(90231—9 x 10000) +4) mod 13 
=2314 mod 13 
=047 
Pattern unmatched and shift is applied. 
Step 6 





For S=5, t,, , = t, = (10(2314 = 0 x 10000) + 1) mod 13. 
= 23141 mod 13 
=14#7 

Pattern unmatched and shift is applied. 


Step 7 





ForS =6, ae =t, = (10(23141 -2 x 10000) + 5) mod 13 
~ . =31415 mod 13 
=7 
Here,.P=t,,, 
Pattern matched will shift S = 6. 
= 19-5 = 14. If any other 


This is done till S=n-—m= 
match is found, it is also a pattern 


match. In this, the only 
pattern is at S = 6.' : : 


in and write Knuth Morris Pratt algorithm for 
ing and also comment on its running 
[R.T.U. 2017] 


Q.7 Expla 
pattern match 


time. 
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F of Algorithms ; 


OR Given a pattern string P, each as Position; = 
. . : , a position can be obtaj n =9 
Write the KMP string matching algorithm and also | P® caer owes . Shean itausence from wie Step 3, Now q ep D 
find the prefix function for the following pattern: a | restart the ma ch Occurs im tty | 3. > O and P [4] ¥ P [9] (true) ] Q9 5 ; 
after j" position. It can be accomplished in t Meq ‘7 suggest an approximation algorithm for traveling 


teP ; thenk < 1 
steP ~* n(91< ! 


teP itis, the final table is 


babbabaaand implement the algorithm for one 


step. [R.T.U. 2013] Sales person problems using minimum spanning 


fr ee algorithm. Assume that the cost function 
Satisfies the triangle inequality. [R.T.U. 2016] 


lay 
manner. | he folly 
e From the original string consider a substrin 
e Starting at the end of the substring, “s]jq erat 
original string. It along te 
'  e We have a potential restart position for a Mism; 
j'" position, where all overlapping character matche iy 
e Take an auxiliary array - “next”, and store that 
Ape 


potential restart position for j. 
Pi-[i [273743] epm 
PP fa fb re 















Ans. Knuth-Morris-Pratt-Algorithm : In Brute-Force- 
Algorithm, we have to backup the text pointer for every 
mismatch. Some characters are examined twice or thrice 
depending upon the shifts for the given pattern. The finite 
automata is used to eliminate the needless shifts, but the 
complicated preprocessing for the computation of transition 
function pays off. The working of KMP algorithm is similar 


Ans. If for the set of vertices’a,b,c, € V, it is true that t (a,c) 
< t(a, b) + t(b, c) where t is the cost function, we say that t 
satisfies the triangle inequality. 

First create a minimum spanning tree the weight of 
which is a lower bound on the cost of an optimal traveling 
salesman tour. Using this minimum spanning tree let us create 
a tour the cost of which is at most 2 times the weight of the 
spanning tree. 





Runnin a 
aunning time of 0(m). The matching time for KMP- 








matcher is 0(n). 





to the finite automaton matches; in this, pattern string P, and Step 1. m< length [P] Get = rrllrril be a pattern and g tree 
jai aber gabe ar ncaa ad ca bags eee) m2 4 T= Irrrirrilirrrirrirrlirirrirrir be a text in a string — ony ‘i aga noc o 
compared. If any mismatch occurs then the algorithm | Step 2. [1] <0 and-also k <0 matching problem : bins pees i th E) 
searchés the largest suffix of the “wrong start” which is also Step 3. Forq <2 tom, ie. q <2 to 9 and n *). many. Shifts (both valid and invalid) will ‘hg mn garnens 

; ses Step 4. do while k>0andP [k+1]#P| pOWq52 (i) How hon bo ciei hiss aiseiniad 1. Select a “root” vertex r € V [G]. | 
a prefix of a pattern P. Thus, it determines the shifting of the 0>Oand P [1] #P [2] q], i.e, pe made by the aive Ss ring matching algorit im? 2. UseMST-Prim (G,c,r) to compute a minimum spanning 
pattern P forpossible match.  ‘ Step 5.- It will t (fals) |‘ (ij) Provide the algorithm to compute the transition tex fain # 

The KMP algorithm has a linear running time of O(n +m), - 6. IfP (kt 1] Pal 6 PT1sPr function for a string matching automation. 3. Assume L to be the sequence of vertices visited in a 
which is achieved by using the auxiliary function Pf(prefix Step ae scal'dee cuca Le., P [1] =P [2] (false (iii) Find out the state transition diagram for the}. preorder tree walk of T. . . 
function), pre-processed from the pattern P in time O(m). Step 8. [q] <k, ie. x [2] —0 automation to accept the pattern P a if 4, Return the Hamiltonian cycle H that visits the vertices 
The function P computes the shifting of pattern matches within Again Step 3. Now q = 3 7 _ [R.T.U. 2017) in the order L. a ee odng of the - 
itself. It can be observed that if we know that how the pattern Step 4. 0>0andP [1] #P [3] ' (al ——————————=<'r'-Tre oom |}_ The next set of figures show 
matches shifts against itself, then we can slide the pattern Step 6. IfP[1]=P[3] _ \ 4 pa Ans. p=rrllrril proposed algorithm. 

: Weed erategl tgegtegtealCatestegts @).- 


more characters towards right than just one character as we 


@) 


Step 7.” thenk<k+ lie, kel 





have seen in the Brute-Force algorithm. Step 8 [3] <1 (i) Total shift = T(n)—p(m)+ 1 
KMP MATCHER (, P) Again Step 3. Now q=4 =30-8+1 ©) o 
1.n € length [T] Step 4. 1>0 and P [2] #P [4] (false) =23 
2.m < length [P] _ Step 6. If P [2] =P [4] (true) Valid Shift = 0 : 
3. <- COMPUTE-PREFIX-FUNCTION(P) ae : ae ae tlie, k<2 Inward Shift = 23 : 0 
4. 0 CP Ge [4] <= 2: ” ipa 
: oe cae of characters matched. Again Step 3. Now q=5 (ii) The algorithm is to get the next state from us 
a . > Scan the text from left to right Step 4. 2>0and P [3] #P [5] (tn) | current state for every possible character. 
- do-while q> 0 and P[q +1] + T[i] Step 5. thenk <0 . Given a character x and a:state k, we can get the next 












_ k-1]x” which is 








7. do q « nq] > Next character does not match: Step 8 2[5]<0 State by considering the string “patt [0 .. . 

8. if P [q +1] = T[i] ; Again Step 3. Now q = 6 basically concarnation of pattern characters patt(0], patt(l],} . Om Sh ceiulanempanteion after the MST- 

9. then qd q+I1 pNext character matcher Step 4. 0>0andP [1] #P [6] on + patt[k — 1] and the character x. The idea is to get larger | Fig. : A set of pa =e posits bai‘iees apniied’ 

10. ifq=m_- ‘p'Is all of P matched ? Step 6. IfP [1] = P [6] (tM? | of the longest prefix of given pattern such that the ee = In figure (a) a set of vertices is shown. Part (b) 

11. then print “Pattern occurs with shift” i-m Step 7. thenkek+ l,ie., ke 1. also suffix of “patt [0 ... k-1]x”. The value of length gives illustrates the result of the MST-Prim thus the pee 

12.q <—{[q] _» Look for the next match, pe ee Gee ae "text length, : ‘spanning tree MST-Prim ee ‘sh hate 

For instance ; If for a given pattern P, a mismatch is Step 4 ee (il (i) like {A, B, C,D, E, A) bot pate ie as me 
detected at some position j then we know that we have alread S Tk ue ( | hes a saat >t Opin I tou for a set 
matched j ~ 1 characters successfia iy By this hea we y Step 6. IfP (2]=P [7] ae Now, assume H* to be an siouey: at ae 
decide the possible shifts, so that we can restart our mat can tep 7. thenk<—k+ l, Le, kK<—2 if vertices. A spanning tree is constructe y del a ar 
ching. | Step8. xn[7]}<2 . from a tour. Thus, an optimal tour has more weight than the 


Consider the string “10100” which is mismatched at 5‘ 












which means that the weight of the 


. Again Step 3. = rennet ing tree, ; 
eee fd ae know that the text so far matched. Step 4. 2 “i O and P iy +P [8] ta Sead aie tree forms a lower bound on the weigh 
matching a #4 =i . is not known. Thus, we can | Step 6. If P [3] = P [8] of an optimal tour. ~ a) 
ys iets which is ‘1° against the Step 7. thenk << k+ lie, k <3 ot) s c(H*) ire 
am Step 8. 1 [8] <— 3 é 









hi . 









Let a full walk of T be the complete list of palit 
when they are visited regardless if they are visited for the 
first-time or not. The full walk is W. ' 

W =A, B, C, B, D, B, E, B, A 

The full walk crosses each edge exactly twice. Thus, 

we can write: 


c(W) = 2c(T) (2) 
From equations (1) and (2) we can write that 
(W) < 2c(H*) (3) 


Which means that the cost of the full path is at most 2 
time worse than the cost of an optimal tour. The full path 
visits some of the vertices twice which means it is not a tour. 
We can now use the triangle inequality to erase some visits 
without increasing the cost. The fact we are going to use is 
that ifa vertex a is deleted from the full path if it lies between 
two visits to b and c the result suggests going from b to c 
directly. el 
We are left with the tour: A, B, C, D, E, A. This tour is 
the same as the one we get by a preorder walk. Considering 
this preorder walk let H be a cycle deriving from this walk. 
Each vertex is visited oncé so it is a Hamiltonian cycle. We 
have derived H deleting edges from the full walk so we can 


write: 
c(H) < c(W) (4) 
From (3) and (4) we can imply: 
c(H) <2 c(H*) (5) 


This last inequality completes the proof. 
——————<£_$—<—_<_£_¥_—X—X—X—X—!—_S 
Q.10 State lower bound theory. 

[R.T.U, 2015, Raj. Univ, 2008, 2007, 2006,2005] 
a 
Ans. Lower Bound Theory : If two algorithms for solving 
the same problem are discovered and their times differed by 
any order of magnitude, then the one with the smaller order is 


generally regarded as superior. A function g(n) that isa lower | : 


bound on the time that any algorithm must take to solve the 
given problem. If we have an algorithm whose comiputing 
time is the same order as g(n), then we know that 
asymptotically we cannot do anything better. 

If f(n) is the time for some algorithm, then we write 
f(n) = Q(g(n)) to mean that g(n) is a lower bound for f(n). 
Formally this equation can be written, if there exist positive 
constant c and no such that |f(n)| > clg(n)| for all n> no. In 
spb °C developing Pa bounds to within’a constant factor, 

also concerned wi ini 
cr pears a determining more exact bounds 


Deriving good lower bounds j if 
D is often more difficult than 
the efficient algorithms, Perhaps this is because a lower 
po States a fact about all Possible algorithms for solving a 
oblem. Usually, we cannot enumerate and analyze all these 


gorithms, so lower bound proofs are often hard to obtain, 


B.Tech. (V Sem.) cs. Po 
However, for many problems it js Poss 
observe that a lower bound identical to N exj f ty? 


the number of inputs (or possibly Outputs) to s Te: 
example, consider all algorithms that find the ‘: Problem 9! 
unordered set of n integers. Clearly every inte ino 
examined at least once, so 2X(n) is a lower bone Muy 
algorithm that solves this problem. Or, Suppose n fry 
find an algorithm that efficiently multiplies two : ei Wish 
Then Q(n’) is a lower bound on any such algori i 
there are 2n’ inputs that must be examine aid ch Sng 
that must be computed. Bounds such as these OUtpys 
referred to as trivial lower bounds because they..." ° 
to obtain. We know how to find the maximum of nel 

by an algorithm that uses only n— | comparisons 5, : a 
no gap between the upper and lower bounds for this ie, 
But for matrix multiplication the best-known algorithm 
O(n? + €) operations (€ > 0), and so there is 
believe that a better method cannot be found. 


a. 
° a 


—P 
s 


cy are Ve 


equi 


Q.11 Find the "pattern ABCBC in the next 
ACABABCABCBCA using KMP matcher, 


. [R.TU. 2019 
eee 
Ans. The given string is ACABABCABCBCA . ° 
We have to find : ABCBC 
Step-I oy . 

. ACABABCABCBCA 
' ABCBC 


Fail __ Failed at position 1, fail (1) = 0, so we can 
Value jump by (1) —(0) =1 
—} 


me 


0 
.0 
he 
0 
Step-II 
ACABABCABCBCA 
ABCBC 


Fail . Failed at position 0, fail (0) = 1, so We 
Value can jump by (0) —(-1) = 1 
- 


0 
0 
0 
0 


ARWNK OS 


—e 


AWN OO 


Step-III » ga 


ACABABCABCBCA 
ABCBC 


Fl oe { Failed at position 2, fail (2 


~j Fajue jump by (2)—(0)=2 


lem | 


s 


) = 0, so we can 


al: 


" 

ae 

4 0 - 

3 ee 

sey ABABCABCBCA 
AB CBC - 

“""\gail Failed at position 3, fail (3)=0, 50 we can 
' value jump by (3)-(0)=3 . 
ies - | 
i 9 
Ae 0°: 

3 0 
Ae 03%, 
SP CABABCABCBCA | 
ABCBC . 
Fail - Match Found 
Value 
05 =F 
1%, .0, 
2 0-.. 
3. 0. 
4 0 
String found. 








Q.12 Solve the Travelling Salesman Problem (TSP) for 
the following graph by using the branch and bound 
algorithm, the tour must be start from vertex 1 and 
generate only tour in which 2 is visited before 3. 

1 





Fig. 


[R.T.U, 2013] 


st matrix from 


Aus. Step 1: First we have to make the co the number of 


© given graph. Rows and columns denotes 


Cities in the graph. 
| “4° 3 3..4 6 20aN> 
1] 2 3 1 5 8 
2| co . 0 6 7 9 
From city-+3}0 0 © 4 2 
fhe wo 0,0 3] 
5)c0 wo OM 


SS ee ee eee 


(AAA7) 


Cost of going from city i to City iis oo 
_ edge (i, i) is o. 


.. The edges (1, 1), (2, 2), (3, 3) (4, 4) and (5, 5) all is 


_ So, weight of other edges are as provided in the cost 
matrix. ° 


Step 2 : Now, we have to reduced cost matrix, R. This is 


doné by selecting the smallest element from each row and 
column and subtracting it from all other elements. 


The aim is to have at least one zero in each row and 
column. The other entries of the matrix must be non-negative. 
Reduced cost matrix is constructed to get better minimum 
cost value. 


2 


9x 
2} © 
3] © 
4] 


5] 00 


8 8 8 8 Yw& 
8 8 8A 
a 
Bw wee u 
tb 


1| 00 
2| 00 
3] 00 
=> 4a 


8.8 8 8 NN 
8 88 eco 
8 8NH RF 
So oOWN MY 


5] 00 


1 
1] « 
2| 0 
3] © 
4} co 
5| 00 
ine every column and rows are at least 1 zero. . 
Total amount of subtracted in the process of finding 
reduced cost matrix = 1 464+24+34+2+1=15 
This total amount will ees the root of the search 
nding to given graph. 
een is Pi a node of parent node ree - red 
node there is an edge between the two nodes as C i : i 
all entries in row | and column 2 of the feduced cost m 


=> 


88 8 8 On 
88 8oo™ 
8 8 =~ ow 


5 
a: 
3 
sl? 
0 
re) 


to «. This prevents the use of any more edges leaving vertex 
1 or entering vertex 2. 





—————————— 
Q.13 Solve the TSP problem for the following cost matrix 
x y zw 
xfA 10 15 20]: 
y{5 A 9 10 
z|}6 13 A 12 
wi8 8 9 A 





[R.T.U. 2012] 








Ans. 
g(2, $) = ¢,, = 5 


g(3, >) = c,, = 6 
a(4, >) =c,, = 8 
. (2, {3}) =c,, + g(3, >) =15 
(2, {4}) =8 
(3, {2}) = 18 
(3, {4}) =20 
(4, {2}) = 13 
(4, {3}) =15 


Next, we compute g(i, s) with |s|)=2,i #1, i ¢ s, and 
i¢gs. 





g(2, (3,43) = min (eps +803, (4),¢04 + 2(4,(3}} =25 
8(3,{2,4}) = min {cy + 8(2,{4}), c34 +8(4, {2})} = 23 
B(4, {2,3}) = min {c4p + g(2, (3}), C43 +8(3,{2})} = 23 
Finally 
B(1,{2,3,4}) = min {cy + g(2, 3, 4}), 013 +803, {2,4}),c14 


— + 8(4, {2,3})} 
=min{35, 40, 43) , aa. 
= 35 


Q.14 Find a Hamiltonian circuit using backtracking 
method for the following graph G = (V, E 


[R.T.U, 2012] 





ns. For finding Hamiltonian circ 


‘bed uit Backtracking algorithm: 


First algorithm gi 
ves all reals ettreyl dla = _ nae 
Algorithm Next Value (k) : 
Mx U:k-1Jisa path of k—1 distinct vertices 
If x [k] = 0, then no vertex has as yet been 


. § 





B.Tech. (V Sem.) ‘C.S. Sole 
// assigned to x [k]. After execution, x Tar d Pan 
// assigned to the next highest numbered Verte; 
// which does not already appear in x (1: kt x 
// and is connected by an edge to x [k=] a 
// Other wise x [k] = 0. If k =n, then in a 
// x [k] is connected to x [I]. 


{ 


ddition 


repeat 
(eth, | | 
~ x [k]: = (x[k] +.1) mod (n+ 1);//N 
if (x [k] = 0) then’return; 
if (G [x[k-1], x [k]] + 0) then 
{ // Is there an edge ? 
for j : = 1 to k-1 do if (x [j] =x [k]) then brea 
// Check for distinctness 
if (§j =k) then // If true, then the vertex is distinct, 
if (c <n) or ((k=n) and G [x[n], x[1]] + 0)) 
then return; . 
} | 
} until (false); . 
} ‘ 
Algorithm to find all Hamiltonian Cycles 
// This algorithm uses the recursive formulation 
-// of backtracking to find all the Hamiltonian ? 
// cycles.of a graph. The graph is stored as an 
j //adjacency matrix G [1:n, 1:n]. All cycles begin 
// at.node 1. fos 
{ 
repeat 
{// Generate values for x[k]. ; 
Next Value (k); // Assign a legal next value to 
_ . // x [k]. 
if (x [k] = 0) then return; 
if (k= n) then write (x [1 : n]); 
else Hamiltonian (k + 1); 7 
} until (false); . 
} 


‘trons 
According to these above algorithms the Hamilton! 


circuit for the given graph are 


(1)a, b, Cc, e, d, a 


: (2)b, C, a, e, d, a, b 


(3)c, e, d, a, b,c 
(4)e, d, a, b, Cc, e . 


(5)d, €, c, b, a, d 


“at Vertex 


= of Algorithms 
ce 







solve the TSP problem having the following cost 
WP gtrix using branch and bound technique, 


A B C D 
ATX 5° 2 3 
B)4 X 2 3 
C 4 32- -X -3 
D\7 6 8 xX 


ee 
Ans According to cost matrix 


A-B:.C D 
AIX #52 3 
opi 4, X° 2 3 
cj4° 2° xX 3 
DI7 6 8 X . 
subtract the minimum quantity from each row 
Row:A = Row A-2 
Row B = Row B-2 
Row C = Row C-2 
‘Row D = Row D - 6 
The reduced matrix is now 


A'‘B C D 
Alo 3 0 1 
Bl2 0 0 1 
“RC *cla 0 @ 1 
Di1 02.0 
Still column A and D do not have any zero. So, we 
teduce them properly. . 
Column A= Col A-1 
Column D=ColD-1 | 
’ Hence, the reduced matrix is . 
| A B.C 'D 
Afo 3 0 0 
Bll 0 0 0 - 
RC “Cc 1 0 @ 0 
plo 0.2 @ 


i ' | ities 
The lower bound is calculated as sum of all quantiti 
Subtracte d. ) 
Lower bound =2+2+2+6+! 
V The tree constructed for this problem 
; N Mex of cost 14. The root node correspon 


+1=14 
will start 4 root 
ds to the vertex 


[R.T.U. 2018, 2011] 


matrix is already reduced. 





We expand this node by computing path values from A 
to B, C and D. 


Considering path A > B, we formulate a matrix FC 
by setting row A and column B to infinity (00). Also, entry 
[B, A] =~, so that the path does not trace back to vertex A. 

. ABCD 

Alo 0 © ow 
_Blo wo 0 0 
“Cll © © 0 
Di0 © 2 

In these matrices either a row or column should have 
all values oo or have at least one zero. As we can see this 


FC 


, 


Total reduced quantity, r=0 
Nodevalue, Ig =I, +r+RC[A, B] 
=14+0+0 
=14 
Now, we can also take path A > C, for which the 
corresponding matrix will have row A and column C set to 
oo. And the entry [C, A] = ©, so that the path does not trace 


back to A. - 
A BCD 
Alo o 0 © 
Bll o o 0 
FO elco: 0 <4 
DJ0 0 m7 wo 


This matrix is also already reduced. Hence r= 0 
Nodevalue, Ic=I,+r+RC[A,C] 
- =144+0+0=14 
. Considering path A > D, we have a matrix with row 
A and column D set to © and the entry [D, A] = . 


ABCD 

A[o © © © 

Bl) 1 © 0 @ 

FC =¢ 1 0 ‘0 © 
. Dio 0 ‘2 © 

Subtract 1 from column A. 

A BC D 

Aja o 0 
BIO o 0 @ 
FC “clo 0 © @ 
Dion 0 2 @ 


* Total reduced quantity, r= | 





KE : Bik (V Sem.) C.s. Solve 3 Algorithms 

Nodevalue, Ip =I, +1r+RC[A, D] ‘Since, there are no different paths now to < CZ 5 Ce es. 
=14+1+0 have found the solution. The solution path js *Plorg We 4 a Lal TeTeTo) — 

| " p J © mate 


The tree looks like, Total path cost. =C[A,B]+C[B, cy t 
. »>C) ta 


\ 










7 8 9 10 It 12:13 14 15 46 


1 Hence retum index 12, be i 
. a ; Cause a match with the patt 
fitkle}s] [m]ataTe qo] sresaning is found from that location it tex, —_— 
' Algorithm 


oo Naive (T[l....n],P[1....m)) 


al, ) 

=St+2+3 47817 ] C1, B ze 
Note that this is same as value of last je 

where we found the solution. 


Choosing the minimum node to expand, we select node | Q.16 Explain Naive string matching algority —~ ~ 
- im USin 





Node in tee 
. ‘. ’ 


// Problem Description : This algorithm finds 


of value 14. Upon expansion it will lead to following paths suitable example phere 
aking path A -> B -> C we formulate the matrix FC by OR [R.Ty, 204 ioe mete d. 
We | . : : : nd pattern 
tting row A, row B and column C to oo, Also the entries | Describe Naive string matching algorithy, ; no for (s < 0 ton—m) do : 
-, A] and [C, B] are set to oo, Thus, & pie IN detaipy B 45 6 7 8 9 10 ll 12 13 14 15 16 
; . 2 TU, 3 
- A BCD ———————— pele PE TT Tel ToT eT No match found. eg | eee ml =F [stl 33.42 stm] then 
- a oe ae __ | Ans. String matching algorithms are normally useq t print (“pattern finding with shift”, s) ; 
| "processing. This text processing is often dene A text ate ar } 
Fel os a compilation of source program. In software design or in wig (ees 6 7 8 7 OM Is 6 }// end of algorithm 
oe design, text processing is an important activity, String tn fe lm | mt Li lkle Ts] [mle [ats [0 | Nomatch found Analysis 
- ae) means finding one or more of all the o courrences of ing ) In the given example, if a match is not found then shift 
That is already reduced so, r= 0 in the text. These occurrences are called as patte on 7 the pattern to right by 1 position i.e. almost always we are 
Nodevalue, I, =I, +r+RC[C, B] matching algorithms are also called as Patter a¥ String [+ [=le to) fay nae di . ae 4 shifting the pattern to the right. The worst case occurs when 
=14+0+0=14 Algorithms. n. atching ele Be eT Tel TTT] Noda gua’ |. We have to make all the m comparisons. This results in worst 
Taking path A > B => D, we formulate the matrix FC One of the pattern matching algorithm is Naive Method ' . ris time complexity of © (ma). Fora typical wore mired 
setting row A, row B and column D to 0, Al i Nai © This j . eon : in natural language the average case efficiency is © (n). 
A] and [D. B] 0 00. Also the entries Naive Method : This is the simplest method which .. fie Te Tod ) Basic Notations and Terminologies 
| 9S) APS SCLTO'20- . se using Brute Force approach. The Brute Force is a | y Iti das ‘sigma star’ 
A BCD straight forward approach of solving the problem. This pia s4s 6739 ouReeee . : It is pronounced as ‘sigma star’. 
anise | (ce TeTs ToT A To Ts TT Tole To To To ] nomen is notat 
Si has “Just do it” approach. This aerate performs checkin Tele Te ToT Pats Tee TT Tote Peds Lo JNomeniond | - This notation denotes the set of all 
Be. eee at all positions in the text between 0 to n—m, whether an finite length strings formed using 
FC= ae et sala x pattern starts there or not. Then aftereah | ,, , 3, , fels[otsto} 9 he input set z 
attempt, it shifts the pattern by exactly.one position to the (PeP el bell T [el Tlele] o match found. e.g. : 
Oe 2 right. If the match is fi es ae a eT ToT Ti Bet Te TT Tole Tels le) al “* ie fz aad, ...} 
- Subtract 1 from column A and 2 from column C . : 1 Is found then it returns otherwise the ND 1 Dafa} then Liale ses, oat 5 
ee en matching process is continued by shifting one character 0 Zero length string It is called empty or null string. It 
. the right. If there is no match at all in the text for the giv" | o, , 4 de 3 fas [ots tod cut ate de “is denoted by « (epsilon). . 
Alo © © pattern even then we have to don comparisons. This method | [:]s] eta] Tt li Pele ts] [mde [a [s Lo] Nomict fount | ja] : Means length of a string a. r 
FC = BJD © © ow can be explained with the help of some example. — Concatenation : The concatenation of strings x an 
ClO 0 © w Example ; , . | . ys denoted by xy with length 
| ! ma fe Jo | ; 
DI» © 0 ow Consider the text and pattern as given below: SB 0.9:.8>-§ - 6-9 pete [et 213 14 15 16 , |x|+|> . The concatenation means 
oe oe hii. Qi 234 5 67 8 9 jon 12 13 14-15 16 ‘bho Dy re Pee: | Tle [ale Le} Nome ont ’ characters sale followed by 
evalue, Ip=Ig+ r+ Re EEE T DT Te Tle [le bs)” | The prefix means previo 
ere a D) ls Im Jo Ta] Ti Ti fkle ys] [me [als lel 8 t . Prefix ofastring + The prefix: means previously 
, BEE . : occurring strings if w is prefix of 


The tree now looks like , a eS | | \ 5 16 
ale [a Te Ts rn | aimee me string a then it is denoted as 
erm 3 noe No mat so 
. ele TeT TT Tele bel Tole Tel | “he 
e string 










_ __ Wewill start finding match for pattern from 0" Jocation t . : The suffix means th 
fext. If the match is not found then shift to the ris!" mye [*lelel | Suffixofastring = + are occurring after particular 
pais : or $43 6.9.4.4 10.0 12.0.4 ccamatoual . ___ string. It is denoted by ]. Ifw is a 
oA RS dvs ie se a a cgak Ghee ERECT pe lel De Tel] suffix of some string a then it 1s 
BE EDT DERE ee eee . ee oa 

£. Sa al pays [= Te Te! These notations are used in string operations. 





(AA‘52) 


: 





Q.17 Explain the prefix function for a string with an 
example and write KMP matcher algorithm? 


[R.TU. 2012] 

OR e. 
Write short note on Prefix function for string 
matching. [R.T.U. 2018] 





Ans. Given a pattern P[1...m], the prefix function for the 
pattern P is the function 
7: {1,2,......,m} —> {0,1 
Such that 
m[q] = max {k +k <q and P,]P,} 


i.e, m{q]is the length of the longest prefix of P that is 
proper suffix of Pa 





P= ababababca and q=8. The m°function for the given 
pattern. Since n[8] = 6, x[6] = 4, n[4] = 2 and 
™ we obtain - 

——- [8] = {6,4,2, 0} 


n[2] = 0 by iterating 





ca n[8]=6 
abe a n[6]=4 
aba b.c a n[4] =2 

1 
f£i4baba ba be a n[2]=0 


KMP Matcher Algorithm : Refer to Q.7. 


18 (a) Write an algorithm for solving n-queen problem. ) 
Trace it for N=6 using backtracking approach. 

(b) Describe Travelling salesman problem. Show - 
that a TSp can be solved using backtracking 
method in the exponential time. —_[R.T.U. 201 7] 


s. (a) Algorithm for Solving n-queen Problem x 

eens Problem’ — . 
Ina game of chess, a queen is a game-piece which can 

ck in all directions that is vertically, horizontally, or 

onally (both rising and falling). | 

Problem Definition . ; 

The n-queens problem is the problem of placing n chess 

ns on an nxn chessboard such that none of them are ‘in 

king position with respect to any other using the standard 


3 queen's moves. Hence, it is also called the 
ns Problem. ee 


(UU 


_ amount of time it will take: 


So first we find whether a solution exists or not? Ify 


B.Tech. (V Sem.) C5, aE 
‘ The eight-queens problem is defined as - a oN 
board, of 8x8 fields, is it possible to place g iv "ag 


NG 
board, so that no two queens can attack ea queen, 
Similarly, four-queens problem could 

























ch Other» tig 
also be de fn 





Fig. 1 : Directions of Attack b : 
ectl Y a Queen 
Thought Process 


_Asimple approach to solution requires that no two queens 


share the same row, column, or diagonal. This is'so because | 


aii earned any of ksi blocks the TOW 
(rising and fallin Siioee raters ti Sr ae 
} g) at whose intersection the queen was 

placed. 
Naive approach says we can form all possible 
permutations of board positions and check them. But this 

‘means checking n” candidate solutions. Imagine the large 

We can use the following tricks to reduce the numberof 
candidate.solutions 
“ ¢ Checking for Same Row : Place queens row by 
row, like queen 1 in row 1, queen 2 in row 2 ands 
on till queen n. In this way, no two queens are placed 
in same row automatically. 

‘ Checking for Same Column: Try all columns ix 
a queen i except the column in which queet Ee 
placed. Thus, we reduce a column. But, new qu" 
must not be attacked by the ones at the toP " 
have already been placed on the board. If w® s 
remember columns of all previous queens, thea 
can exclude them also from the candidate solutice 
This reduces the number of candidate solutio™ 
n!. +, the 

We have found a solution if we placed a quee® ‘ : 

bottom most row, that is if we reach a leaf node 4” 

board position is still valid, - . | 


: ions: 
Not all the, n-queens. problems have prope! .solut 


te 


of Algorithms ) : 
gE “possible solution? Also, there is more than one 


whit A solution. 
por yor ueens Problem 
pet US start at n=2, and increase further. | 
etwo-queens problem does not have a solution. It is 


: ajustrated by the Fig. 2 given below. 
be 


‘ 7 
: . . 
3 | 3 


Fig. 2.: Possible Placing of Two Queens 


_ Three-Queens Problem 
The three-queens problem is illustrated in the Fig.2. 
Possible situations of these queens are shown in lists and 


discussed below. 


List A: Place the first queen in first row, first column. } 


Try placing a queen in second row. It is finally placed in second 
row, third column. Now try placing third queen, no place is 
found correct. So we backtrack. But second row queen is in 
last position, so backtrack one level up. We come to situation 
listB. 2% a 
‘List B : We start by placing first queen in second 
column. Then place second queen in second row. But no 
place is valid. Hence backtrack. so, 
‘List C : Place the first queen in third column. Try placing 
second queen. Second row first con is good place. Now for 
third queen in third row no column is valid place. So backtrack. 
Try another position for second queen, which is not found. 
So there is no solution. 





Accept 


Start at 1 Invalid Move Invalid Move 


List B 





Invalid Move 


Backtrack 


Start at2 Invalid Move Invalid Move 


\ 


List C 








Invalid Move Invalid Move Invalid Move No Solution 
Backtrack. - 


Fig. 3 : Possible Placing of Three Queen’s . 
Hence we can conclude the three-queen’s problem does 
not have a solution. 
Four-Queen’s Problem 
_ The four-queen’s problem is solvable. We explain here 
a detailed solution using backtracking. First we construct the 
search tree for four-queens problems, as shown in Fig.4. 


(1) 
'G @ Mm - aC) 
2 3} 4 N 3 1 2 a 4 2 ‘ 
G) @ & (9%) @) @) Gs) @) @) G) © @ 
1 4. 1 2 1 J 
DS6SHd 4660600 800060 60000 . 
1 
SDD DOBBS BROVOH OVHOOH 


Fig. 4 : Search Tree for Four-Queen’s Problem — 
Now we conduct the depth-first traversal of this tree. 
Traversing the path node 1 — node 2 — node3, we 
come to invalid position, as shown in the grid.So, prune the 
tree below node 3 and backtrack to node 2. 






Traversing the path node 1 > node 2 > node 8 ci node 
9..we come to invalid position, as shown in the grid.So, 
backtrack to node 8, since there are still other paths from 


node 8. The, subtree at node 9 is pruned. 


i de 11 also 
th node 1 > node 2 > node 8 > no 
eine And, now the, paths from node 8 are 


ives invalid position. 
sti $6, backtrack till node 2. Subtree rocted at node 


11 is pruned. 























| 
; The pruned tree and+he path to a solution Jeg ee 


= (k-1) > G-W)=G-) 




























the Fig 5. By symmety there can be other Solutions 1. i aH =(k +1) => (i-k) =(1-j) 
This is not a unique solution. . aly | is the.difference between rows is same as 10000 0 
|  petween columns, which is a diagonal Position. 000000 
N= 6: ; 
Taking the path node 1 -> node 2 -> node 13 > node 14 (00 ae =) ; 0000 
-» node 15 we.come to invalid position, as shown in the Pes 5. or 0 0000 
grid.Backtrack till node 13. 1; 0 0 ; 000000 
| 9001 0 000000 
990000 —- ; 
901000 100000 
The path node 1 —> node 2 > node 13 > node 16 gives 7 0 0000 001 0 00 
an invalid position, as sho-vn in the grid. And, no further paths ; acne 8 wb 
are left till node 2. So, backtrack to node 1. Subtree at node l . =i te 00 
16 skipped. 1000 0 0 5 ar : 6 
. ', 00 0 0 eat 
; Fig. 5 : Path to a Solution of Four-Queen’s Problem. Dea 00-000 0 
Eight-Queen’s Problem | “01 0 2 oe | 
First we have to construct the search tree for eight: “0 0.0 0 0. 0 i:4 
_ | queens problems, which would we very large to build. After 00-1 0 0 0 
Traversing the path node 1 — node 18 > node 19 also'| this, conduct.a depth-first traversal of this tree. Backtrackas |». 0000 0 0 
gives an invalid position. So, backtrack The subtree at node | soon as invalid board position is found and prune any subtree | ae 
19 is removed. : 


below that point. There are many solutiOns possible. One 
such solution is shown in Fig.6. ' 








Traversing the path node 1 > node 18 — node 24 also 


gives an invalid position.So, backtrack to node 18. The subtree 
at node 19 is pruned. ° 


Fig. 6: A Solution of Eight-Queens Proble a 1 
Asa tuple the solution can be reported as (3, 5,2” 





4, 6). 
: of If 
: To implement an algorithm for the eight-quee"™® 
Taking up the path node 1 - node 18 -> node 29 general a tees Be on de-can soni mathematic! 
node 30 node 31 gives a valid position. It is shown in the model to check that no tw. in same row, © 
grid.Hence solution found. | or diagonal OGReSnSAppeaht ; 


Jacite 
Checking for same row is already handled OhY dled 


one queen in each row. Check for same column is 

by decreasing the number of leaves in every level 0" a 

Checking for diagonal includes the following calculati? they 
If two queens are at positions (i,j) and (k)!): | dition 


are on same diagonal if one of the following two © 
; hold: : 
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coooocoone 


coooCo Cc Oo 
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oo cco Co & oo oc Oo & 
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Ans. (b) Travelling Salesman Problem : A travelling 
salesperson has to travel a group of cities, which are connected 
to each other. - 

There is a cost associated with travelling from one city 


| to other city. The salesperson wants to travel in such a way 


that he visits every city exactly once and returns to the city 


| where he started. Also, cost of this tour needs to be minimized. 


_ Now, this network of cities can be represented through 

a directed graph with weighted edges, where a vertex denotes 
a city. Weight of an edge (i,j) denotes the cost of travelling 
from vertex i to vertex j. Since cost of travelling from city ito. 
city j can be different from the cost of travelling from city j to 
city i, we have directed edges. 

Problem Definition 

Given a graph G with a cost function C(i,j) defined for 
each edge (i, j) in G, we want to find the minimum cost tour 
that visits every vertex in G and returns to the starting vertex. 

We define a function x(i,j), such that 


_.» {l, .ifcityj comes directly after city i in the tour 
x(ij)= 0, otherwise 


The objective is to minimize >» Xji-Cj» subject to the 


constraint that x(i,j) should be so chosen that no city is visited 
twice except the starting one. 

Algorithm — 

Upper bound for all node 
u{i] = ©, for all i. , 
Lower bound is calculated by a bounding function. 

We can compute for each edge (ig) the minimum cost 
path beginning at i, ending atj, while visiting all vertices ofG 
along the path. We generate this path by augmenting current 
path by one vertex at a time (that is with each iteration of the 


algorithm). 


s is assumed to be 00. Hence, 


‘(AAS5S8) 
© At any point we have a partial path P, starting at 
vertex i, we consider only those vertices which are 
- not in P for augmenting the path. This is the 
branching step. 

e A path has a ‘dead end’ if the vertices not in P are 
disconnected in G - {e}. This is used to stop 
branching. 

e A lower bound is defined as sum of path cost and 
cost of new edge. That is, total cost of edges 
already in path P added to cost of edge e. This is 
the bounding algorithm. Mathematically, 

* Wj) =i) + RC(i, j)+r 
where, /(i) is lower bound of parent node i 
I(j) is lower bound of current node j 
RC(i,j) is the (i,j) entry of RC matrix which is obtained 
by reducing the cost matrix of graph G r is a factor introduced 
by aumenting the path. 
After we have run the algorithm for one edge in G we 
can use the best path (path with minimum value) found so 
far over all tested edges for next iteration of the algorithm, 
using this path as current best solution(partial). Thus, we apply 
the algorithm recursively. 
We have found a solution when all vertices have been 
visited. . 
TSP Solved Using Backtracking Method : We are given 
a set of .n cities, with the distances between all cities. A 
traveling salesman, who is currently staying in one of the 
cities, wants to visit all other cities and then return to his 
starting point, and he is wondering how to do this. Any tour 
of all cities would be a valid solution to his problem, but our 
traveling salesman does not want to waste time: he wants to 
find a tour that visits all cities and has the smallest possible 
length of all such tours. So in this case, optimal means: having 


the smallest possible length. 


In Branch and Bound method, cost of any tour ati be 
written as below 


Cost of a tour T = (1/2) x (Sum of cost of two edges 
adjacent to u and in the tour T) 
where u € V" 


For every vertex u, if we consider two edges through it 
in ‘ he sum their costs. The overall sum for all vertices 
would be twice of cost of tour T (We have cons; 
eae oe ( considered oveny{ 
(Sum of two tour edges adjacent to u) >= 
minimum weight two edges adjacent to u) 
Cost of any tour >= |/2) x > (Sum of cost of two 
minimum weight edges adjacent to u) 
where u € V 


(sum of 











Algorithm TSP Backtrack(A, /, lengthSop; 
1. n«length[A] // number of elements 
A 
2. Us=D 
3. then minCost <— min(minCost 
distance[A[n], A[I]]) Vee 
else fori<-/+1ton | ; 
do Swap A[/ + 1] and A[i] // select Afi] sa 
city 28 they 
newLength < lengthSoFar + distance 
[AVL A+ 1) 
7. ifnewLength > minCost // this w 
solution : 
8. then skip // prune 
else minCost <— . . 
min(minCost, TSP Backtrack (A,/+ |: newLe 
minCost)) : Tg 
11. Swap A[/+ 1] and A[i] // undo the selection 
12. return minCost 
_The worst case complexity of Branch and Bound remaiy 
same as that of the Brute Force clearly because in Wont 
case, we may never get a chance to prune a nade, Whereas 


S 
In teay 


+ 


ws 


10. 


‘in practice it performs very well depending on the differey 


instance of the TSP. The complexity also depends on te 
choice of the bounding function as they are the ones deciciy 
how many nodes to be pruned. na 








Q.19 Discuss Boyer moore pattern matching algorithn 
with appropriate example of good prefix and bl 


character. [R.T.U, 2017, 0) 
, OR 

Explain Boyer Moore Algorithms with suitable 

example. = + pR.TU. 
OR 4 


Explain both: the heuristics of Boyer- Mi 
Algorithm with suitable examples... [RT 


Ans. The Boyer-Moore Algorithm : If the pate 
relatively long and the alphabet string S is reasonably } 
then an algorithm by Robert S. Boyer and J. Stroll 
is likely to be the most efficient string—matching nee 
Boyer—Moore-Matcher (T, P, 2) 

/T is text 

//P is pattern’ 

n < length[T] 

m <- length[P] son (P ps 

A < Compute-Last-Occurrence-F oe 

Ye Compute-Good-Suffix—Function ( 

Se 0 
; while s<=p—m 


NnhWHD — 


Il never be ab | 





2 - of Algorithms 
Eo ee ee 
4 while 0 and {PLi]=Tls + j)} 
g doje J 
i then print “Pattern occurs at shift” s 
12 s<s5 + 7l0] ea 
7 ise s 5+ max(ylj} j—ALTIs +) 


ie de from the mysterious—looking A’s and y’s, this 
program jooks remarkably like the naive string-matching 

ithm. : 
a sest 1 

yy ebsesestt rs 

The while loop beginning on line 6 considers each of the 
mt! possible shifts ‘s’ in turn, and the while loop beginning 
fa line 8 tests the condition P[l..m] = T[s + 1 ..., s +m] by 
comparing P[j] with T[s +j] for j =m,m—,...., 1. Ifthe loop 
terminates with j = 0, a valid shift &j—As been found, and line 
[I prints out the value of s. At this level, the only remarkable 
features of the Boyer—-Moore algorithm are that it compares 


the pattern against the text from right to left and that it increases" 


the shift son lines 12-13 by a value that is not necessarily 1. 

The Boyer—-Moore algorithm incorporates two heuristics 
that allow it to avoid much of the work that our previous string— 
matching algorithms performed. These heuristics are so 
effective that they often allow the algorithm to skip altogether 
the examination of many text characters. These heuristics, 
known as the “bad—character heuristic” and the “good — suffix 
heuristic”. They can be viewed as operating independently in 


- parallel. When a mismatch occurs, each heuristic proposes 


an amount by which s can safely match without missing a 
valid shift. The Boyer—Moore algorithm chooses the larger 
amount and increases s by that amount.: when line 13 Is 
teached after a mismatch, the bad—character heuristic 
proposes increasing s by j — A[T(s + j)], and the good-suffix 
heuristic proposes increasing s by YL]. 





(a) : 
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(c) 
_ Fig. 





(a) Cerio <xanple of Boyer-Moore heuristic. 
ee ng the pattern reminiscence” against a text by 
romparing characters in a right to left manner. The shift s is 
Invalid; although a good suffix “ce” of the pattern matched 
correctly against the corresponding characters in the text - 
(matching characters are shown shaded), the bad character 


“?”, which didn’t match the corresponding character “a” in 
(b) The bad—-character 


the pattern, as discovered in the text. 
heuristic proposes moving the pattern to the right, if possible, 
by the amount that guarantees that the bad text character will 
match the rightmost occurrence of the bad character in the 
pattern. (c) With the good—suffix heuristic, the pattern is moved 
to the right by the least amount that guarantees that any pattern 
characters that align with the good suffix “ce” previously found 
in the text will match those suffix characters. 
The bad-character heuristic : When a mismatch occurs, 
the bad—character heuristic uses information about where the 
bad text character T[s + j] occurs in the pattern (if it occurs at 
all) to propose a new shift. In the best case, the mismatch 
occurs on the first comparison (P[m] # T[s + m] and the bad— 
character T[s + m] does not occur in the pattern at all, (imagine 
searching for a™ in the text string b"). In this case, we can 
increase the shift s by m, since any shift smaller than s+ m will 
align some pattern character against the bad—character, causing 
a mismatch. If the best case occurs repeatedly, the Boyer— 
Moore algorithm examines only a fraction 1/m of the text 
characters, since each text character examined yields .a 


mismatch, thus causing s to increase by m. 


In general, the bad—character heuristic works as follows. 
Suppose we have just found a mismatch : P[j] # T[s+ j) for 
some j, where 1 <j <m. We then let b be the largest index in~ 


_the range 1 < b <m such that T[s + j] = P[k], if any such k 


exists. Otherwise, we let k = 0. k = 0, the bad—character 


'T[s+j] didn’t occur in the pattern at all, and so we carsafely 


increase s by j without missing any valid shifts. k <j: the 
rightmost occurrence of the bad-character is in the pattern 
to the left of position j, so that j-k>0 and the pattern must 
be moved j — k characters to the right before the bad text 
character matches any pattern character. Therefore, we can 
safely increase s by j — k without missing any valid shifts. 
k>j,j—k<0, and so the bad-character heuristic is essentially 7 
proposing to decrease s. This recommendation will be ignored 
by the Boyer-Moore slat acid good-suffix heuristic 
i a shift to the right in all cases. 
ig rere simple program defines Afar] to be the index 
of the right-most position in the pattern at which character a 
occurs, for each a € 2. Ifo does not occur in the pattern, 
then A[a] is set to 0. We call d the last occurrence re 
for the pattern. The expression i= A{T[s + jl], implements t : 
bad-character heuristic. (Since j — A[T(s + j))) is eee 
the right most occurrence of the bad-character T[s +j] in 
pattern is to the right of position; we rely on the positivity ° 


vi). 


bad character 
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(c) 


Fig. 


Fig. shows the cases of the bad—character heuristic. (a): 


The bad-character occurs nowhere in the pattern, and so the 
pattern can be advanced by j =n characters until it has passed 
over the bad—character. (b) The rightmost occurrence of the 
bad—character in the pattern is at position k <j, and so the 
pattern can be advanced by j —k characters. Since j = 10 and 
k=6 forthe bad-character i, the pattern can be advanced 4 
- positions until the i’s line up. (c) The rightmost occurrence of 
the bad-character in the pattern is at position k > j. In this 
example, j = 10 and k = 12 for the bad character e. The 


bad—character heuristic proposes a negative shift, which is’ 


ignored. 

Compute—Last-Occurrence—-Function (P, m, Z) 
1 for each character @ € I 
2 do A[a]=0 - 

3 forj<ltom. 
4 do A[P[j]] <j 
5 retumA 

The running time of procedure Compute-—Last- 
Occurrence—Function is O(|Z| + m). 

The good-suffix heuristic : Let us define the relation 
Q~R (read“Q is similar to R’) for strings Q and R to mean 
that Q3aRorR5Q.Iftwo strings are similar, then we can 
align them with their rightmost characters matched and no 
pair of aligned characters will disagree. The relation 


ce 99 


symmetric : Q~ R if and only if R~ Q. _ 
QaRandS 5R imply Q~sS, (1) 
If we find that P i 


Lj] # T[s + j], where jm , then the good— 
suffix heuristic says that we can safely advance s by 


« 


B.Tech. (V Sem.) GS. Sol 
y[j] = m — max {k:0<km and Py ON 
That is, Y[j] is the least amount we can ad ‘ sy 
not cause any characters in the “good suffix» Th . : 
s + m] to be mismatched against the new alte + i+ : 
pattern. The function y is well defined - for ment of, 
P[j + 1..m] ~ Po for all j : the empty string j, = lj, Sing 
strings. We call y the good-suffix function fo, the, ar to a 
We first observe that y[j] <m—zx[m] for all atten 
If w= n[m], then P, 3 P by the definition of x. Fu s folloy, 
since P[j + 1 .. m] 3 P for any j, we have P,, ~ Pf; STMote 
Therefore, y[j] <m—[m] for all j. ls ny} 
Definition of y 
yl] = m - max {k : n[m] and PHj + Lm] ~p 
To simplify the expression for Y further, we dein i}. 
the reverse of the pattern P and m' as the Correspondin Px 
function. That is P'[i] = P[m —i+ 1] for i= 12. 8 Pref 
m(t) is the largest u such that u <t and P', 5 P', 
Ifk is the largest possible value such that P 
then we claim that 1'[/] = m-—j. 
where P=(m—k) + (m—)). To see that this claimis well 
defined, note that PG + 1 ... m) 3 Py, implies that m- isk 
and thus /<m. Also j <mandk <m, so that /> 1, We prov 
this claim as follows. Since P[j + 1..m] 3 Py, we hay 
P'n-j 3 P'). Therefore, n'[/] > m — j. Suppose now tha 
p> m —j, where p = n'[/]. Then, by the definition of 7, ve 
have P’p’ 3 P", or equivalently, P'[1..p] = P'[I-p+1.]. 
Rewriting this equation in terms of P rather than P,,ve 
have P(m —p + 1 m) = 
Substituting for / = 2m — k —j, we obtain P(m - p + 1.a] 
= P[k—m+j+1.k—m+j +p], which implies P[m-p+l.s] 
TI Pmsjtp: Since p> m—j, we have j + 1 >m—p+1,ans 
P[j +1 ..m] 3 P[m— p+ 1..m], implying that P[j + |]? 
Pymsjtp by the transitivity of 3. Finally, since p> m-}™ 
have k'>k, where k'=k—m+j+ p, contradicting our cho 
of k as the largest possible value such that P[j + |.m]? h 
This contradiction means that we can’t have p> ™~) si 
thus p = m—j, which proves the claim. n'[/] = m-J _ é 
that j =m-— n'{]] andk=m-—/+ n'[lj, we can rewrite © 
definition of y still further. bet 
yb] = m — max({x[m]} ies 
U{m-/+nx'[J];1<1<M 
=min({m-n[mJ} 
U {J=n[l] :1 <1 <mandj=m-71}) 
Again, the second set may be empty. 
Compute-Good-Suffix—Function (P, ™) 
1 « € Compute—Prefix—Function (P) 
- P' © reverse (P)_ Suerte 
_ mt <— Compute—Prefix—Function (P’) 
forj<Otom 
do y[j] <— m-2[m] 
forl!<1tom 


[+ L..m) 5p, 


(0) 


m and j =m- 


Nn Lh Wb 





| Step - 4:3. 


doj<-m-nl] 
1 if y[j]> l-r{l] 
8 then y[j] <—1-x'[]] 
retum Y 


; rocedure Compute—Good-Suffix—Function is a 
ott forward implementation of equation. Its running time 
Fit 


a worst-case running time of the Boyer—Moore 

thm is clearly O(n — m + I)m + [2], since Compute- 

"occurrence-Function takes time O(m + |3)), 
fast- ‘er-G0O d—Suffix—Function takes time O(m), and the 
Sxtsor e algorithm (like the Rabin-Karp algorithm) 
Bids O(m) time validating each valid shift s. 


— = are ere 
920 What is backtracking? Explain 8-queens problem, 


also write algorithm for the same. - — [R.T.U. 2016] 
OR 

What is backtracking. [R.T.U. 2015] 
' OR 


Write the short note on backtracking algorithms. 
[R.T.U. 2010, 2009] 
ooo OOS 
Ans. Backtracking : Backtracking is a technique of solving 
aproblem by trial and error. However, it is a well organized 
trial and error. We make sure that we never try the same 
thing twice. We also make sure that if the problem is finite . 
we will eventually try all possibilities (assuming there 1s enough 
computing power to try all possibilities). 
Backtracking imposes a tree structure on the solution 


. Space. Backtracking does a preorder traversal of this tree, 


while processing the leaves. It saves time by using pruning, 
that is, by skipping those internal nodes that do not promise 


“useful leaves, 


Backtracking Algorithm 7 ) 
. General steps involved in a backtracking al gorithm are 

Step - 1: Choosea basic object, like strings, combinations 
and permutations. 
Apply divide and conquer apron 
generate these basic objects. Imple 
through recursion. — 
The test of desired propery 
base of recursion, that 1s W! 
To include pruning, place the cod 
oo: before each recursive cal 

ig. 1 sh w during traversal 1 

ti ton in acs we wteirack to visit ee 
. Visiting of other branch by coming up 0n© 4 etl 

then following a level down in other Gane 

cking. It is done till a good solution Is ound. | 


Step - 2: 


rty is placed at the 
th the leaves. 
e for pruning 


Step - 3: 


al if we do not find 


, 











Fig. 1 : Illustration of Backtracking 
In general case, we assume our solution to be a vector 
v = (a,, a, ... a,), Where each element a, is selected from a 
finite set S;. And follow the steps given in the Fig. 2. It is a 
general algorithm for backtracking. We always begin with 
empty solution, augment it at each stage and check whether 
we are going in the direction of feasible solution or not. 


Step-1 : Builda partial solution of lerigth k, that is 
v =(a,, a, ... a) 
Try to extend it by adding one more: 
element from set S,. 
Test whether this augmented vector is still 
a possible solution. If no then delete last 
element. If yes and k=n, report the solution 
and exit. . 
If there are elements left in S,, go to step 
2, else return. 
Fig. 2 : A General Backtracking Algorithm a. 
To generate all solutions, the algorithm is slightly modified. 
Instead of exiting after reporting a solution, we continue till all 
solution vectors have been tested. Each time we find a possiole 
i ereportit. 
aaa oF acres a aaliei : Actually, two 
i i orithms exist: - 
ia paar which the solution needs only to 
be feasible (the solution must satisfy problem 
constraints). Backtracking stops as soon as a 


Step-2 : 


Step-3 : 


Step-4 : 


‘ 


feasible solution is found. For example, the problem | 


i m of subsets, n-queens problem. — 

“2 eee ae in which solution needs to be eae 

It should be feasible also. This occurs when = 

apply backtracking to optimization ina re) 

example, knapsack problem, assignment problem, 

' ete. : , 

p: iven problem has a set 0 

| ait se veaibly sc oljective function. The solution 

ae a objective function, and/or is feasible. We can 

se the solution space for the problem using a state 
re 


here : 
space ae root of the tree represents 0 choices. 
e 


> 
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